(19) 



(12) 



(43) Date of publication:: 

07.08.2000 Bulletin 2000/23 



Europdlsches Patents mt 
European Patent Office 
Off Ice europten des brevets 0*0 ; EP 1 006 689 A2 

EUROPEAN PATENT APPLICATION 

(5i). ! int a. 7 - H04L 1/48 " ■ ' 



(21) Application number: 99123734.8 

(22) Date of filing: 30.11.1999 



CM 
< 

00 

<o 

CD 



CL 
UJ 



(84) Designated Contracting States: 

AT BE CH CY DE DK ES R FRGB GR IE IT U LU 
MCNLPTSE '; ; '.'*•"'".".;:' 

Designated Extension States: 
ALLTLVMKROSI 

(30) Priority: 30.11.1998 JP.34046998^. 

06.08.1999 JP 22337999 v . 

(71) Applicant: > . , 
Matsushita Electric Industries Co. Ltd. 
Kadoma-shl, Osaka 571-8501 (JP) 

(72) Inventors: 1 

• Fukushlma, Hldeakl 
Kashlba-shi, Nara-keri 639-0265 (JP) 



• tforil, Seljl ^ 

Kashlhara-shl, Osaka-fu 582-0018 (JP) 

• Ohnlshl, Tatsuya 

Kawanlshl-shl, Hyogo-ken 666-0104 (JP) 

• Hagal, Makoto 

Osaka-shl, Osaka-fu 532-0022 (JP) . ; 

• Matsul, Yoshlnori - . 
Katano-shl, Osaka-fu 576-0021 (JP) 

. MlyazaW, Aklhlro ; - : , : ~ 
Wgashlosaka-shl, Yoshlta 578-0983 (JP) 

^74) Representative: - 
ElsenfOhr, Spelser & Partner 
Martlnlstrasse 24 "... - 

28195 Bremen (DE) 



(54) Packet retransmission control using priority Information 



(57) A data transmission apparatus for relaying data 
transmitted from the transmitting end in units of packets, 
each packet having additional information relating to its 
sequence number, priority, and data reproduction time, 
comprises: a receiving unit for receiving packets trans- 
mitted from the transmitting end; a priority decision unit 
for deciding the priority of each of the received packets; 
a retransmission; packet storage unit for storing packets 
the priorities of which are equal to or higher than a pre- 
determined value, as retransmission packets, on the 
basis of the priority of each packet deckled by the prior- 
ity decision unit; a retransmission instruction receiving 
unit for receiving a retransmission request from a termi- 
nal at the receiving end; a retransmission decision unit 
for deciding whether retransmission of the packet for 
which the retransmission request has been made 
should be performed or not, on the basis of the retrans-. 
mission request and the storage status of the retrans- 
mission packets in the retransmission packet storage 
unit; a transmission queue management. unit for setting 
the transmission order of the received packets and the 
packets which have been decided as packets to be 
retransmitted, on the basis of additional information 
which is given to each packet; and a transmission unit 
for transmitting the data of these packets in the trans- 
mission order set by the management unit. Therefore, 
the transmission quality in a radio section in real-time 
transmission is improved and, further, the number of 



retransmission times is reduced. 
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Description - ? ^.^-^ „ , : ; 

FIELD OFTHElNVENTioN -"■ * 7 

[0001] . The present invention relates to data trans- 
mission methods, data transmission apparatuses, data 
receiving apparatuses, and a packet data structure and, 
more particularly, to a process of performing data trans- 
mission in packet units between a distribution server 
and a terminal while successively reproducing the data 
of received packets at the terminal. - - 

BACKGROUND OF THE INVENTION C:: \ , -./J" 

[0002] retransmission of video (audio and video), 
data on the Internet, a download ; type transmission 
method and a stream type transmissionmethod are cur- 
rently employed. . . A ^ ' .. ^-jz^ 1 
[0003] In the download type transmission, method, a - t 
video fOe transmitted from a distribution server is once 
copied at the t^minal and, thereafter, data of the video ■ 
file (video data) is reproduced. So, the terminal cannot 
perform data reproduction until the file transmission^ is , 
completed, therefore, the download type transmission ■ 
method is not suitable for: long-hours reproduction;: of 
video data orthe like. >. 
[0004] . On the other hand, in the stream type trans- 
mission method, while video .data or the like is transmit- ; 
ted from a distribution server to a terminal, receive 
data is reproduced at the terminal. . - 
[0005] - Recently, a stream type transmission ; 
method using a protocol called. RTF (Real-time Trans- 
port Protocol) which is defined in IETE RFC 4889, has, 
mainly been used.,— ;: : ~: • - .-- zt? r< : ? 
[0006] Figure 28(a) is a diagram for.: explaining a 
video data transmission method according to the RTR - 
[0007] : With reference to figure 28(a)v-a distribution 
server (transmitting end) and a terminal (receiving end) 
such as a personal computer are connected by a cable 
in the Internet, such as modem, ISDN, or LAN, and 
transmission of video data is carried out between the 
server and theterminal by using the RTR - c 
[0008] : In the data transmission according; to the 
RTF, processes for the respective packets are synchro- 
nized between the transmitting end and. the receiving 
end by using time stamps as time information, and 
asynchronous (late arrival) packets and packets 
affected by transmission errors are discarded at the 
receiving end. Further, discarded or lost packets are 
detected at the receiving end, according to the absence 
of sequence numbers given to these packets. 
[0009] On the other hand, Internet applications uti- 
lizing mobile phones, for example, mail access and text 
information service, are advancing now, and infrastruc- 
ture for high-speed radio data communication (high- 
speed packet communication of -384kbps) is under 
preparation for practical use of the third generation 
mobile communication (W-CDMA: Wide band-Code 



^ Division Multiple Access). . ; 
r-* [0010] :? Figure 28(b) is a diagram Il8ustra8ng:a oom- 

< i municatron : network ;for the above-described : W-CDMA 
f... visual terminals - * " ^ s. ' . " : 

5 r [0011] - Such' communication network 'includes a 
" radio transmission section. For example, when perform- 

>: ing data transmission between a video distribution 

, e A server and a visual terminal through a relay server, the 

- ^section between, the distribution server and the relay 
: io • server is a cable transmission section by the. Internet, 

but the section-between the relay server and the visual 

- ~ _ terminal; is a radio transmission section, by a mobile 

>:phone network such asthe W-CDMA.,r . ; * / - • 

- ; [001 2] ; :;. However, the bit error rate in the radio trans- 
^rs ^mission section is 40* 3 while the bit error rate in the 

--: cable traasmissiort section is 10' 5 - 10" 7 , and the radio 
, , - ^ transmission quality becomes a problem in the RTF 
•r ..-type data transmission method in which the reproduc- 
■ • /-tion quality depends on the end-to-end (server-to-termi- 
^20 , rial) transmission quality.. - u v 

,7 ' SUMMARYrOF THE INVENTION 

-rtar [0013] I --. The present invention is made to solve the 
25 above-described problems and has for its object to pro- 
. - vide a data transmission method, a data transmission 
apparatus, and a data receiving apparatus, which can 

r improve the transmission quality in a radio section in 

;;; > : real-time transmission. 
30 r [0014] ■ .Other objects and advantages of the inven- 

i r-j : tion will become apparent from the detailed description . 

,£ ii- ,that follaws. :The; detailed description and specific 

v ; ^ embodiments described are provided only for illustra- 

-/ - : .tion since: various additions and modifications within the 

: 35 ^ scope of rthe invention will be apparent to those of skill in . 

>■-•■ the art from the detailed description. / 

z . [0015] t» According to a first aspect of the present 
: invention, there is provided a data transmission method 

- for performing continuous data transmission from the 
/ 40 - transmitting end to the receiving end in units of packets, 

■ each packet having additional information relating to its 
• . sequence number, priority, and data reproduction time 
at the receiving end, while successively reproducing 

- . data of packets received at the receiving end. This 
45 method comprising the steps of: at the transmitting end, 

giving priority information to each packet to be transmit- 
. . ted; and storing, as retransmission data, only data of 

- • ■■ packets the priorities of which are equal to or higher 

than a predetermined value, in a retransmission buffer; 
so-, at the receiving end, when a transmission error is 
detected, detecting the priority information of an error 

- packet; and when the detected priority is equal to or ■ 

- higher than the predetermined value, outputting a 
retransmission request for the error packet to the trans- 

55 - mitting end by indicating the sequence number of this 
error packet; at the transmitting end. only when the data * 
. of the packet having the sequence number which is indi- 
cated by the retransmission request from the receiving 
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end is stored in the retransmission buffer, retransmitting 
the data of this packet to the receiving end; arid 'discard- ' 
ing the data stored in the retransmission, buffer irrorder 
starting from a packet which oannotbe in time for data. 1 
reproduction at the receiving end. Therefore, the trans-, 
mission quality in a radio section irtreaMime transrhis- 
sion is. improved ^ and,, 'further, the- number- of 
retransmissionlimes is reduced, v.. 



and when a transmission error has occurred in the 
packet of the extracted sequence number, a retransmis- 
r Ofsion request for this error packet is made by indicating 
* the sequence number of this packet. Therefore, the 
s^? transmission quality in a radio section in real-time trans- 
; i misston is improved and, further; the number of retrans- 
; u; mission times is reduced. > *^ 
^ c [0020] According tb a sixth aspect of the present 



[0016] According to a second aspect Of the present^ • invention; thefe is provided a data transmission appara- 
inverrtion, in the data transmission method 6f the fir^t " Jo - 4 tus for relaying datawhich are successivelytrarisrnitted 
aspect, when the -retransmission buffer is filled uptoit^ from' the transmitting 'end in units of packets, each 
capacity, an updation process is performed, in which . i* s. packet having additional information relating to its 
retransmission data are retairfed'whilethe data' stored ^ ' '-Sequence number, priority, data reproduction time at the 
in the retransmission buffer are discarded in order, statt- " ^receiving end. This apparatus 'fcbmpriles: a receiving 
ing from a packet of the earliest reproduction time? on < & f -' unit for receiving the packets transmitted from the trans- 
the basis of the reproduction time of each packet stared n ™ - -"mitting end;- a-pnority decision unit for deciding T the pri- 
in the retransmission buffer. Therefore, the transmission - & '- Grity of each of the received packeta; a retransmission 
quality in a radio section in real-time transmisfiforrfe^*"-'?^ packet storage- unit for storing packets the" priorities of 
improved and. further; the number of retransmission^ ^ which are equal to or higher than a predetermined 
times is reduced. , nr c ;> v:;: 

[0017] According to a third aspect of the present a -Grity ef each packet decided by the priority" decision unit; 



invention, in the data transmission method of the first 
aspect, when the data transmitted from the transmitting - 
end to the receiving end is video data based on MPEG, 
a packet which contains data corresponding to frames 
coded by utilizing intra-frame correlation is regarded as 
a packet having a high priority. Therefore.'the transmis^ 
sion quality in a radio section in real-time transmission * 
is improved and, further, the number of retransmission 
times is reduced. ot-.: v - 

[0018] According to a fourth aspect of the present . * 
invention, in the data- transmission method of the first 
aspect, at the transmitting end, the additional informal?* 
tion relating to. the sequence number and the priority of .: v 
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a retransmission instruction receiving-unit for receiving 
a retransmission request 1 from a terminal at the receiv- 
ing end;>a 'tetransmission decision unit -for deciding 
whether retransmission of - the packet" for which the 
retransmission request has been made should be per- 
formed or not, on the basis of the retransmission 
request and the storage" status of the retransmission 
•packets in the retransmission packet storage -unit; 51 a 
transmission queue management unit for setting the 
fc p transmission order of the received packets and the 
packets which 'have been decided as packets to be 
retransmitted, 'on the basis of the additional information; 
j-and a transmission unit for transmitting the data of theso 



a predetermined packet is also embedded. in a subset r as r:packets in the transmission order set by the manage- 
quent packet tobe transmitted after the -predetermined f vnent'unit Therefore-only the error packets the priorities 
packet; and at the receiving end; in the- case iwherera 1 ) 'nr ^ of which are ^eqola^ to or higher than a predetermined 
transmission- error has occurred -in thecpredeterraihed R 'O value cambe retransmitted, whereby the transmission 
packet and the additional information of the predeteryow 
mined packet has an error, a retransmission request fop 1 " *o 



the predetermined packet as an error, packet is made on : 
the basis of the- additional information of the predeter? 
mined packet which is embedded in the subsequent: 
packet when the subsequent packet transmitted after 
the predetermined packet is received. Therefore, the : 
transmission quality in a radio section in real-time trans- : 
mission is improved and,' further, the number of retrans- 
mission times is reduced. 

[0019] According to a fifth aspect of the present - 
invention, in the data transmission method of the fourth 
aspect, at the transmitting end, the process of embed- 
ding the sequence number of a predetermined high pri- 
ority packet in a subsequent packet which follows the 
predetermined high priority packet is continuously per- 
formed until a high priority packet next to the predeter- 
mined high priority packet is transmitted; and at the 
receiving end, the sequence number of another packet 
which is embedded in the received packet is extracted, 
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quality ofca^ radio section in real-time transmission is 
improved and, further, the number of retransmission 
times is reduced. - 

[0021 ] r According to a seventh aspect of the present ' 
invention, there is provided a data receiving apparatus 
for receiving data which are transmitted from the trans- 
mitting end in units of packets, each packet having addi- 
tional information relating ta its sequence number, 
priority, and data reproduction time at the receiving end, 
and successively reproducing the data for each packet. 
This apparatus comprises: a receiving unit for receiving 
the packets transmitted from the transmitting end; an 
error packet detection unit for detecting error packets in 
which errors have occurred -during transmission, and 
outputtingTiormal packets which have been transmitted 
without transmission errors, on the basis of the data of 
the received packets; a packet priority decision unit for 
receiving the output from the error packet detection unit, 
and deciding error packets the priorities of which are 
equal to or higher than a predetermined value; and a 
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retransmission instruction output unit for outputting a 
retransmission request for each of the error packets the 
priorities of which are decided as being , equal ;to or 
higher than the predetermined value, to the transmitting 
end, by indicating the sequence number of this error 
packet Therefore, at the receiving end,: a retransmis- 
sion request to the transmitting end is made only for the 
error packet -the priority of which is equalto or higher 
than a predetermined value, whereby the transmission , 
quality in a radio section in ..real-time transmission is 
improved and, further, the number of retransmission 
times is reduced. . _ f - r , -.. v , . 

[0022] According to an eighth-aspect of thepreserrt 
invention; there is provided a date transmission method 
in which data transmission from the transmitting end to 
the receiving end is continuously performed in units of 
packets, each packet- having r additional { information 
relating to its sequence number, priority, and data repro- 
duction time: at the receiving end, while successively 
reproducing data of packets which have arrived at the 
receiving end and,:at this, time, only packets which can 
be in timoior data reproduction at the receiving end are 
retransmitted., This, method comprises the steps of : at 
the transmitting end, giving a data reproduction time at 
the receiving end to each packet to beitransmitted; and 
storing, as retransmission data, only data of packets the 
priorities of which are equal to or higher than a predeter- 
mined value, in a retransmission buffer;.at the receiving 
end, when a transmission error is detected, detecting 
the reproduction time for an error packet and the arrival 
time of the error packet, and deciding ,an arrival tims 
limit in accordance with the reproduction time; and 
when the error packet has arrived before the arrival time 
limit, outputting a retransmission request- for the error 
packet to the transmitting end by :indjcating^the 
sequence number of this error packet; atthe .transmit? 
ting end, , when the data of the packet having the- 
sequence number indicated by the retransmission u 
request from the receiving end is stored in the retrans- 
mission buffer, retransmitting data of the packet the: 
transmission time of which does not pass the reproduc- 
tion time, to the receiving end, while discarding data of 
the packet the transmission time of .which has passed 
the reproduction time; and discarding the data stored in 
the retransmission buffer in order starting from a packet 
which cannot be in time .for data reproduction at the 
receiving end. Therefore, the transmission quality in a 
radio section in real-time transmission is improved and, 
further, the number of retransmission times is reduced. 
[0023] According to a ninth aspect of the present 
invention, in the data transmission method of the eighth 
aspect, when the retransmission buffer is filled up to its 
capacity, an updation processes is performed, in which 
the retransmission data are retained while the data 
stored in the retransmission buffer are discarded in 
order, starting from a packet of the earliest reproduction 
time, on the basis of the reproduction time of. each 
packet stored in the retransmission buffer. Therefore, 
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the transmission equality, in a radio sectfoa in real-time 
\ transmission is improved and.rfurther, the number of 
•retransmission times is reduced., * ;-rr :■■ 
[0024] ' According to a tenth aspect of this present 
^invention; in th9 data transmission method of the eighth 
; - aspect, the arrival time limit is decided based on at least 
one of the allowable -packet delay time decided at the 
receiving < end, ?and the packet transmission delay time 
between -the : transmitting end and the receiving end. 
Therefore, the transmission quality in a radio section in 

• real-time:- transmission is improved and, further, the 
t number of retransmission, times is reduced. . ■• 

[0025] According to an eleventh . aspect of the 

* present invention,, in the data transmission method of 
-•the eighth- aspect at the transmitting end, additional 
" information^relating to the sequence number and the 
' reproduction time corresponding to a target packet to be 
> transmitted istrembedded ina subsequent packet to be 
£ transmitted aftet the target packet; and at the receiving 

end, whea a transmission error of the target packet has 
. occurred and the. additional information of the target 
packet has an error, a retransmission request for the tar- 
get packet as an error packet is made on the basis of 
the additional information of the target packet which is 
embedded in the subsequent packet, when the subse- 
quent packet-transmitted after; the target packet is 
received. Therefore, the transmission quality in a radio 
section in realtime transmission is improved and, fur- 
ther, the number of retransmission times is reduced. 
, [0026] According to a twelfth aspect of the present 
.invention* there is provided.a data transmission appara- 
tus for relaying data which are successively transmitted 
from the ^transmitting end dn units of packets, each 
.packet having additional information: relating to its 
sequence number, priority, data reproduction time at the 
receivings end. : .This apparatus comprises: a receiving 
- unit for receiving the packets transmitted from the trans- 
mitting end; a priority decision unit for deciding the pri- 
ority. of each of the received packets; a reproduction 
time decision unit for deciding packets which cannot be * 
in time for reproduction at the receiving end, amongst 
the packets to be transmitted to the receiving end; a 
retransmission packet storage unit for storing packets 
the priorities of which are equal to or higher than a pre- 
determined value, as retransmission packets, on the 
basis of the priority of each packet decided by the prior- 
ity decision unit; a retransmission instruction receiving 
unit for receiving a retransmission request from a termi- 
nal at the receiving end; a retransmission decision unit 
for deciding whether retransmission of the packet for 
which the retransmission request has been made 
■ should be performed or not, on the basis of the retrans- 
mission request and the storage status of the retrans- 
mission packets in the retransmission packet storage 
unit; a transmission queue management unit for setting 
the transmission order of the received packets and the 
packets which have been decided as packets to be 
retransmitted, on the basis of the additional information; 
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and a transmission unit for transmitting, in the transmis- the predetermined value and the error packet has 
sion order setsby* the management -unit the ""data W Arrived before the arrival time limit outputtirig a retrans- 
packets other >than ihe packets which are decided 'as?- --mission request for this error packet to the transmitting 
packets that cannot be in time for reproduction at thtf >*-">»*. Snd by indicating -the r sequence- number of this' error 
receiving end, fiy the reproduction time decision unit 5: .'packet; at the fransmitting end. when data of the packet 
Therefore, the transnriission quality irfcairadiQ section in having tile' sequence number indicated by the retrans- 
real-time transmission is, improved and, :furtherj£tbe mission request from tHe receiving end is stored in the 
number of retransmission times is reduced.- ■ ..w.\«. s \ *e \ rjBtransmission buffer, retransmitting only data of the 
[0027] . According, to ^thirteenth aspect oi> the;n packet the transmission time of which does not pass the 
present invention, there is provided a * date receiving- ?io> : reproduction time, to-ther^^ 

apparatus for receiving data which are transmttt^fl^'^^-^^d^ta of the'packet the transmission time of which hasi* 
the transmitting irend In units of packets^ each packet ■ • .. passed the 'reproduction time; and discarding tho data 
having additional infocmation relating touts' sequence stored in the retransmission buffer in order starting from ' 
number, priority,* and -data reproduction time:at-4he f .c!;/ 3 packet *which cannot be in time for reproduction at the 
receiving end; and . successively reproducing, the idata i. t^teceiving end. Therefore, the transmission quality in. a • 
for each packet. This apparatus comprises: aT'eceivirijnD'* o-radio section in real-time transmission is improved and, 
unit for receiving the packets transmitted from the'trariB- r ^-"*--'-.ft | r1her, the number of retransmission times is reduced, 
mitting end; an error packet detection unit for detecting:! *% . [0029] r . According to ^fifteenth aspect of the present 
error packets in which errors have occurred adoring* .^'.t invention/In the data t^smissfon Itiothod o? the four- 
transmission, and -outputting normal: packets s which; ~2Q~. steenth aspect at the transmitting end, additional" infor- 
have been transmitted without transmission errors,* on"^ L mation retatingto the sequence number; fee 'priority, - 
the basis of the data of .the received packets; a repro-^ ^ and the reproduction time of a predetermined packet is, 
duction time decision unit for detecting the reproduction - embedded Tin a subsequent packet -to transmitted 
time given to each error packet detected by the error - ^ after the predetermined packet: and at the receiving - 
packet detection unit and the arrival time of lhe error 25 . end, when ^a transmission error of the predetermined - 
packet at the receiving end, and setting the arrival time :^ t — packet has occurred and^the additional information of ^ 
limit based bn^the reproduction time, and ^deciding: - ^the predetermined packet-has an error, a retransmit* 
whether or not the error packet has arrived atthe receiv-- v sion request for the predetermined packet as an error" 
ing end before the arrival .time limit; anct a retransmit packet is made on the basis of the additional irrforma- 
sion instruction output . unit > for t outputting- ^a . action of the predetermined packet which is embedded in 
retransmission -request only^for the error packet .which ; r the subsequent packet, when the subsequent packet 
has arrived at the receiving end before the arrival; time *.cw.4- transmitted after the predetermined packet is received, 
limit to the transmitting end, by incOcatingthe sequencer oi . Therefore, the transmission quality in a radio section in ; 
number of the error, packet, on the basis of the result of^rt? * * teal-time 7 transmission is-improved and, - further, the 
the decision., in. the reproduction : time decision unit* wi:>-number ofiretransmission times is reduced. .-v. 
Therefore, the transmission quality in a radio section inoriv ^ e {0030] According to a sixteenth' aspect of the 
real-time, transmission is .improved and, further, .the?r?K' e: present invention, Jn the data transmission method of 
number of retransmission times is reduced. , . - • . s :w vj\ 'i~the fifteenth aspect; atthe transmitting end, 1he process 
[0028] Accorcfing to a- fourteenth aspect %of the* ^iin of embedding the sequence number of a predetermined 
present invention/there is provided a data transmission ' JO: : high priority packet in & subsequent packet which fol- ; 
method for performing continuous data : transmissions ^: lows the predetermined high priority packet is continu- 
from the transmitting end to the receiving end in units of i ously performed until a high priority packet next to the - 
packets, each packet having additional .information . * predetermined high priority packet is transmitted; and at 
relating to its sequence number, priority, and data repitx the receiving end, the sequence number of another- 

45 packet which is embedded in the received packet is 
- extracted, and when a transmission error has occurred 
* in the packet of the extracted sequence number, a 
retransmission request for this packet is made by indi- 
cating the sequence number , of this packet Therefore, 
so the transmission quality in a radio section in real-time 
transmission is improved and, further, the number of 
retransmission times is reduced. 
[0031] - According to a seventeenth aspect of the 
. present invention, in the data transmission method of 
55 , the fifteenth aspect at the transmitting end, when addi- 
.. tional information relating to the sequence number and 
the reproduction time corresponding to each packet is 
embedded in a subsequent packet to be transmitted 



duction time at the receiving. .end, while successively 
reproducing data of packets arrived at the receiving 
end. This method comprises the. steps of: at the trans- 
mitting end, giving a data reproduction time and priority 
information to each; packet to be transmitted; and stor- 
ing, as retransmission data, only data of packets the pri- 
orities of which are equal to or higher than a 
predetermined value, in a retransmission buffer; at the 
receiving end, when a transmission error is detected, 
detecting the priority information of an error packet the 
reproduction time of the error packet and the arrival 
time of the error packet setting the arrival time limit of 
the error-packet on the basis of the reproduction time; 
and when the detected priority is equal to or higher than 
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after the packet a difference, between additional inter-.-, packets : in the ^transmission packet storage unit; a 
mation relating to the sequence number and the repro- ?retransmission instruction output unit for outputting the 
duction time corresponding to ; the subsequent packet ^ retransmission- request for the error packet requested 
and the additional information relating to the sequence^ \ : ^ by the terminal, to the distributionserver, on the baste of 
number and the reproduction time corresponding to the ~<e r t- the result of the decision in the retransmission decision 
previous packet is embedded as the additional informa- *: unit; a transmission queue management unit for setting 
tion. Therefore, the transmission quality in a radio sec- - Lthe transmission order of the received packets and the 
tion in real-time transmission^ improved and, further; packets which have been decided as packets to be 
the number of retransmission times is reduced. ■ i retransmitted* on the basis of the additional information; 

[0032] According to an eighteenth aspect of the id -< and a transmission unit for transmitting the data of these 
present invention, there is provided a data transmission : 'packets in the transmission order set by the manage- 
method for performing data transmission between a dts- > r: orient unit Therefore, the number of retransmission 
tribution server and a terminal through a relay server in ~ 7 times between; the > distribution server and the relay 
units of packets, and successively reproducing data of : : server can be reduced. - \ • 

packets received at the terminal. This method compris- is [0035] \-e 'According 1 to a twenty-first aspect of the 
ing the steps of : when a transmission error has occurred ' present invention, there is provided a data transmission 
between the relay server and the terminal, performing * method for- performing continuous data transmission 
retransmission of an*errof piacket b/the relay server in : " - ' from the trarismitting end to the receiving end in units of 
response to a retransmission request from the terminal;" 2 : packets, ceach packet having additional information 
and when a transmission earor has occurred between f >20 relating tb its sequence number, ^ority, and data repro- 
the distribution server'and the rielay server, performing ** ^ "duction time^ at the receiving end, while successively 
retransmission of an ^rror packet by the distribution - " ' reproducing^date of packets received at the receiving 
server in response to a retransmission request which - : " end. This method comprises the steps of: at the trans- 
has been transmitted from the terminal through the v mittihg end, when a packet the priority of which is equal 
relay server. Therefore, the number of retransmission 25 to or higher than a predetermined value is transmitted 
times is reduced between the distribution server and the •* " £ ' as a high-priority packet storing data of this high priority 
relay server. - packet, as 1 retransmission data, in a retransmission 

[0033] According to a nineteenth aspect of the buffer; managing the value of the transmitting end high 
present invention, in the data transmission method of priority sequence number which corresponds to the 
the eighteenth aspect, when a transmission erfor has ^ number of transmitted high priority packets, and the 
occurred between the distribution server 'and the relay * value of the sequence number of the high priority packet 
server, a retransmission request is transmitted from the - ^ so that these values are correlated with each other; and 
relay server to the distribution server, and:retransmis- : > * transmitting a subsequent packet which follows the high 
sion of an error packet to the relay server is performed ^ ^ priority packet after embedding the value of the trans- 
by the distribution server. Therefore, wasteful transmis- ^3s Chitting erTdhighprrori^ s^uehce numbef'in tfiis subse- 
sion of error packets from the relay server to the termi- ?r -qiient packet; at the receiving end; extracting the value 
nal is avoided. ■ r * sr.. ^ m. c^bf the transmitting end hic^ priority sequence number 

[0034] According to; a twentieth aspect of the > which is Embedded in the received packet; managing 
present invention, there is provided a data-transmission the value of the receiving end high priority sequence 
apparatus for relaying data which are successively 40 number which corresponds to the riumber of received 
transmitted from a distribution server, in units of packets high priority packets; when the value of the extracted 
each having additional information' relating to its transmitting end high priority sequence nurrtoer is not 
sequence number, priority, date reproduction time at the - " equal to the value of the receiving end high priority 
receiving end. This apparatus comprises: a receiving sequence number, outputting a retransmission request 
unit for receiving the packets transmitted from the trans- 45 to the transmitting- end, by indicating the value of the 
mitting end; a priority- decision unit for deciding the pri- > ' transmitting end high priority sequence number which is 
ority of each of the received packets; a retransmission > obtained on the basis of the value of the receiving end 
packet storage unit for storing packets the priorities, of * high priority sequence number; and updating ttie value 
which are equal to or higher than a predetermined of the receiving end high priority sequence number; at 
value, as retransmission packets, on the basis of the pri- ' so the transmitting end, only when data of the packet hav- 
ority of each packet decided by the priority decision unit; ing the sequence^niimber corresponding to the value of 
a retransmission instruction receiving unit for receiving • the transmitting end high priority sequence nurrtoer 
a retransmission request from a terminal at the receiv- - which is indicated by the retransmission request from 
ing end; a retransmission decision unit for deciding the receiving end is stored in the retransmission buffer, 
whether retransmission of the packet for which the ss retransmitting the data of this packet to the receiving 
retransmission request has been made is to be per-' -■• end. Therefore, retransmission of the high priority 
formed or not, on the basis of the retransmission packet the priority of which is equal to or higher than a 
request and the storage status of the retransmission predetermined value, can be performed by simpler pro- 
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cedures. setting the transmission order of the received packets 

[0036] Accorjfing to a twenty-second aspect of the : and packets which are decided as packets to be 
present irrvention>*in the data transmission method of - >' ' retransmitted; a transmission unit for transmitting data 
the twenty-first-aspect, at the receiving.end; when this " *"^of these packets in the transmission order set by the 
value of the? transmitting end-high priority sequence- - transmission queue management unit; a priority ded- 
number embedded inihe received-packet is not eqljal tb-' " i sion unit for deciding the priority of each of the received * 
the value of, the receiving end high priority sequence * a . packets; aretransmission packet storage unit for storing 
number, aretransmission requests output tolhetrans-'i-- ■ packets the priorities of which are equal to or higher 
mitting end, by 4isting the values rangingirom the vaiue ^ i - than a predelerminedivalue, as retransmission packets, 
obtained by adding 1 to thareceiving - end^high priority w teon the basis of the priority of eachrpacket decided by the' 
sequence number, tathe value of the transmitting^entf *- ^priority decision ^jnit;- a sequence-number management 
high priority sequence number, as the values of'the^r . jounitfor managing the value of the transmitting end high 
transmitting end high priority sequence numbers, or by -^ priority sequence, numbfc -which corresponds to the 
designating thetange as the range.of the values of. the - number idf. transmitted rhigh priorjtyrpackets, and the 
transmitting end high priority sequence numbers: and at re value of th^ sequerKje number of, the high priority packet 
the transmitting end; the sequence nurpbers.cccrre- lico&> that these values are correlated with each other; a 
sponding to the values of the plural transmitting end high priority sequence number insertion unit for embed- 
high priority sequence numbers which are indicated. fey 3 ding the- value of the traremitting-end'high priority 
the retransmission, request from the receiving: end ar^rv -.-sequence number in a subsequent packefcwhich follows 
retrieved, and oply when data of the packets high priority packet; a retransmission instruction 

sequence numbers obtained by the retriev^are^c^ed ^ receivings retransmission request 

in the retransmission buffer, the data of the packets^are - - . j .indicating the Jiighiariority sequence nMmber, from a ter- 
retransmitted to the receiving end. Therefore^/etrans-^^ 

mission of the high priority packet the priority of : which is; ~ son unit for deciding whether retransmission .of the 
equal to or. higher than a predetermined value, can be: packet for- which, the retransmission request has been 
performed by ampler procedures.— • v.. ? made is to,be" performed or not, on the basis- of the 

[0037] . According to a twenty-third .aspect -of the i -retransmission ^request f and the storage status of the 
present invention, in the data transmission method of t-,-- retransmission packets in the retransmission packet 
the twenty-first aspect, at thereceMng end, the retfans- .^. storage unit Therefore, only the error packet the priority 
mission request is performed continuously- be several 30 \Of which' is equal, to ^r. higher than-a predetermined 
times, indicating the value of a ttmsmitting ei?d high pri- value cap be retransmitted, whereby retransmission of 
ority sequence number; and at the transmitting end L tfi* t 0 w ; .the high priority packet .can be performed by simpler 
sequence. number corresponding to tfie.value of the - ^ ^pffocedur^s. t f:L : . • ± 

transmitting end high priority sequeixefiumber ; ^ According-to a twentyrfifth aspect of the 

indicated by the retransmission request from theTeceivr- 35 : .,present Invention, there iS;provided a data receiving 
ing end is retrieved,- and data of the packet rhaviqgrtfce.t: r,^apparatu^,forirec,eiYingxlata which are transmitted from . 
sequence number obtained by the retrievals retrans-^q r ^ the transmitting en$i in units of packets, each packet 
mitted to. the receiving end arid, simultaneously, 'tocK3Pfet?'c!? having additional information relating to its sequence 
respondence between the value of the* sequence g; r e number, priority, and: data- reproduction time .at the 
number obtained by the retrieval and the value -of the . .. 40 c receiving >end. and successively reproducing the data 
transmitting end high priority sequence number indl- \i Gl for each packet This apparatus comprises: a receiving 
cated by the receiving end is deleted. Therefore, when,; . r unit for receiving the packets transmitted from the trans- 
at least one of several transmission requests from the,;- .; ; -mitting end; an error packet detection unit for detecting 
receiving end is normally received at the transmitting an error packet in which an error has occurred during 
end, only the error packet the priority of which is equal 45 transmission,, and outputting a normal packet which has 
to or higher than a predetermined value can be retrans- been transmitted without transmission errors, and the 
mitted, whereby thetransmission quality in a radio sec- value of the. transmitting end high priority sequence 
tion in real-time transmission can be effectively number which corresponds to the number of transmitted 
improved. . . high priority packets and is embedded in the normal 

[0038] According to a twenty-fourth aspect of the so packet; a high priority sequence number management • 
present invention, there is provided a data transmission • unit for managing the value of the receiving end high pri- 
apparatus for relaying data which are successively ority sequence number which corresponds to the 
transmitted from the transmitting end in units of packets, number of normal high priority packets which have been 
each packet having additional information relating to its received without transmission errors, on the basis of the 
sequence number, priority, data reproduction time at the ss output from the error packet detection unit; a retrans- 
receiving end. This apparatus comprises: a receiving mission sequence number decision unit for comparing 
unit for receiving the packets transmitted from the trans- the value, of the transmitting end high priority sequence 
mitting end; a transmission queue management unit for number from, the error packet detection unit with the 
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value of the receiving end high priority sequence 
number, and when these. values are not equal, deciding 
the value of the transmitting end high priority sequence 
number for. which a .retransmission .request is to be . 
made, on the basis of the value of the receiving end 
high priority sequence number; and a retransmission 
instruction output unit for outputting a retransmission,, 
request to the transmitting end, by indicating the value 
of the decided transmitting end high priority sequence . 
number. Therefore, retransmission of the higKpfiority 
packet can be performed with simpler procedures. 
[0040] According to a twenty-sixth aspect* of the 
present invention,- there is provided a data structure of a,, 
packet forperforming data transmission from the. trans- : 
mitting end-and the receiving end, wherein the packet, 
comprises a header section containing relevant irrfor- . 
mation indicating the attribute of the packet, and a data . 
section containing- data to ■ be transmitted; and the . 
header section comprises at least first and second . 
header information, amongst first header information • 20 
indicating, the sequence number corresponding to the r ■ 
packet second header information indicating the priori - 
ity of the packet, and third header information indicating 
the reproduction time at the receiving end, of the datato r - 
be transmitted. Therefore, retransmission of a low prior-, 
ity packet and retransmission of a packet which cannot 
be in time for reproduction can be avoided,, whereby: the 
transmission quality in a radio section in real-time trans? 
mission is improved while reducing the number of 
retransmission times. ... - 
[0041] According to a twenty-seventh aspect of the 
present invention, in the packet data; structure of the 
twenty-sixth aspect, the header section of the packet 
includes attribute information of^a packet which has 
already been transmitted before the packet Therefore, 
retransmission of an error packet can be perfonried J wrtfi 
reliability. i 
[0042] According to a twenty-eighth aspect of the 
present invention, in the packet data structure of the 
twenty-seventh aspect, the header section of the packet 
includes the first and second information or the first and 
third information, as attribute information of a packet 
which has already been transmitted before the packet 
Therefore, retransmission control based on the priority 
or the reproduction time can be performed with reliabil- 
ity. ■ j - ■ • - ' ■ ' ' ' : 
[0043] According- to a twenty-ninth aspect of; the 
present invention, in the .packet data structure of the 
twenty-sixth aspect the header section of the packet 
includes the value of the high priority sequence number 
corresponding to the number of high priority packets 
which have been transmitted before the packet and hav- 
ing the priorities equal to or higher than a predeter- 
mined value. Therefore, the transmission quality in a 
radio section in real-time transmission is improved and, 
moreover, retransmission of an error packet is realized 
by simpler procedures. 
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Figures, 1(a) ; and 1(b) are block diagrams for 
explaining data transmission apparatuses as a 
relay: server and a distribution server, respectively, 
in a data transmission system according to a first' 
embodiment of the present invention. r r 
Figured io a block diagram illustrating a data 
receiving apparatus (receiving terminal) in the data 
transmission system according to the first embodi- 
ment. ~ ' . **-'*■ 

Figure 3 is a sequence diagram for explaining 
packet selective retransmission control in a data 
transmission method according to the first embodi- 
ments v > : ■ .*; ■ ' ■ * . ' 
Figure 4 is-a block diagram illustrating a data trans- 
mission apparatus (relay server) in a data transmis- 
sion system according to a second embodiment of 
the present invention. f * 

Figure '5 is a block diagram illustrating a data: 
receiving apparatus (receiving terminal) in the data 
transmission system according to the second 
embodiment. - \ 

Figure 6 is a sequence .diagram for explaining 
packet selective retransmission control in a data 
transmission method according to a third embodi- 
ment of the present invention. 
Rgure 7 is a block diagram illustrating a data trans- 
mission apparatus (relay server) in a data transmis- 
sion system according to a modification of the third 
embodiment: : ~ vv. - :< .: 
Rgure 8 is a : block: diagram illustrating a data 
receiving apparatus (receiving terminal) in the data 
transmission system according to the modification 
of the third*enrfcodiment ~ - * - ' 
Rgure 9 is a sequence diagram for explaining 
packet selective retransmission control in a data 
transmission method according to the modification 
of the third embodiment 

Rgure 10 is a block diagram illustrating a data 
transmission apparatus (relay server) in a data 
transmission system according to a fourth embodi- 
ment of tfie present invention. 
Figure 11 is a block diagram illustrating a data- 
receiving apparatus (receiving terminal) in the data 
transmission system according to the fourth 
embodiment. . 

Rgure 12 is a sequence diagram for explaining a 

first example of packet selective retransmission 

control in a data transmission method according to 

the fourth embodiment ■ 

Rgure 13 is a sequence diagram for explaining a 

second example of packet selective retransmission 

control in the data transmission method according 

to the fourth embodiment. ? 

Rgure 14 is a sequence diagram for explaining a 
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third example of packet selective retransmission 
control in the data transmission method adcprdintj l. 
to the fourth embodiment 

Figure 15 is a sequence diagram for explaining a 
fourth example of packet selective retransmission s 
control in a data transmission method according io ^ 
a modification of the fourth embodiment ' : ^ m v 
Figures 16(a) and 16(b) are block diagrams ur y- 
explaining a data transmission apparatus as a relay '< 
server and a data receiving apparatus as a recerv- - : ' ia 
ing terminal^ respectively, in a data transmission ^ 
system according-to a fifth ^embodiment of #i©^: ^ 
present invention. /" * »r «^.; r 

Rgure 17 is a sequence diagram for explaining a 
packet selective retransmission control in a data rs 
transmission method according to the fifth embod:- - 
merit * r - .,- - ; v,\* ••.„.*%?■■ 

Figure 18 is a block diagram illustrating a data 1 
transmission apparatus (relay server) di; a data * 
transmission system according to a sixth ombodk 20 
ment of the present invention. . ; - v- 

Rgure 19 is a block diagram illustrating a data: — 
receiving apparatus (receiving terminal) in the data . 
transmission system according to the sixth ernbod- - 
iment. -.-*-> 0 o * : 

Rgure 20 is a sequence diagram for explaining r. 
packet retransmission control with time limit in the c - ' 
data transmission method according to ihe sixth' 
embodiment r ._ - *• 

Rgure 21 is a sequence diagram for explaining - so 
packet retransmission control with time limit,, in a 
data transmission method according to an nwxiifi-V : 
cation of the sixth.embodiment ,\v;,. - 
Rgure 22 is a sequence diagram for explaining ■> ; 
packet retransmission control' with time limit in a ;oj 
data transmission method according: to another 
modification of 1he sixth embodiments ~ . - :.-:v 
Rgure 23 is a block diagram illustrating a data 
transmission .apparatus (relay servor) in a data- • 
transmission system according to a seventh <o 
embodiment of the present invention. 
Figure 24 is a block diagram illustrating a data 
transmission apparatus (relay server) in:;a data : 
transmission system according to a modification of . 
the seventh embodiment. 45 
Rgure 25 is a block diagram illustrating a data - 
transmission apparatus (relay server) in a data 
transmission system according to an eighth embod- 
iment of the present invention. 
Rgure 26 is a block diagram illustrating a data . so 
receiving apparatus (receiving terminal) in the data . 
transmission system according to the eighth 
embodiment . / 

Rgures 27(a) and 27(b) are diagrams for explaining 
a reproduction time estimation method according to 55 
the eighth embodiment, illustrating the relationship 
between the time stamp of a packet and the packet ; 
output time (figure 27(a)) and a time stamp map- 
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ping method (figure 27(b)). 
■ '■ Rgures 28(aVknd 28(b) are schematic diagrams for 
conceptually explaining the conventional video 
transmission system, illustrating a server and a ter- 
minal connected by a cable (figure 28(a)), and a 
server and a terminal connected by a network 
including a tedib transmission section: 
Rgures 29(a) and 29(b) are block diagrams for 
explaining a data transmission apparatuses a relay 
server and a data transmission apparatus as a dis-' 
tribution server, respectively, in a data transmission 
system according to a ninth embodiment 'Of the 
present invention. '' e- y 

Rgure 30 is: a' block diagram illustrating a data ; 
receiving apparatus (receiving terminal) in the data 
transmission system according'fo the ninth embod- 
iment ~ ^ - . - 
Rgure 31 is a sequence diagram for explaining 
packet Selective retransmission control in the real- 
time 'data transmission method according to the 
ninthfembodiment "v? 
Rgure 32 is a block diagram illustrating "a data " 
transmission apparatus (relay server) in a data< 
transmission system' according to a tenth -embodi- 
merit ofthe presentirrvention. ; ^ 
Rgure 33 is a block diagram illustrating a data ^ 
receiving apparatus, (receiving terminaQ in the data ^ 
transmission 4 system according to the tenth embod- 
iment' uV v< - ' *■' **' ' . ' V 

Rgures 34(a)-34(c) are 'diagrams illustrating the **■' 
data structure of a packet for transmitting data by a 
data transmission method according to any of the 
aforementioned embodiments (figure 34(a)), the # 
structure of the packet header (figure 34(b)), and^ : 
the convention of header information (figure 34(c)). 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[0045] Hereinafter, the inventor's viewpoint and the 
fundamental principle of the present invention will be 
described. - • - '■< ■ * . ■ 

[0046] The inventors of the present invention have 
earnestly studied about a method for improving the 
transmission quality in a network including a radio trans- 
mission section, and finally discovered that the trans- 
mission quality in the radio section can be improved by 
performing-real-time retransmission of packets, in the 
existing real-time transmission method. : * • 

[0047] To be specific, in the existing real-time trans- 
mission method, packet data are transmitted in real time 
between a distribution server and a terminal unit 
through a relay server or the like, and additional infor- 
mation (e.g., a sequence number, a time stamp, etc) 
required for real-time transmission of each packet data 
is given to the header of the packet The additional infor- 
mation enables real-time control of packet retransmis- 
sion. 
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[0048] In the data transmission method of the,. . control for error pad^js performed, r to ,j *?r ; 
present invention in which data ti^nsmission is per- , --.-[0056] -First retransmission control Us selective 
formed in real time between the distribution server and retransmission ^control for reducing the "number of 
the terminal through the relay server while retransmis- ; vrefransmission ; times by selecting, as packets to be 
sion contrpl : js performed in real time, thg relay- server 5 rn; retransmitted, high priority Vpackets amongst the error 
may serve as the video dstribution server. Further, as , ^ packets. Second retransmission control is retransmis- 
for the video. ^date..transmissipn. direction, the present, ^Lsion control -with > time limit for. reducing excessive 
invention can be applied to not only the forward trans- , - retransmission by stopping retransmission of packets 
mission from the, distribution server to the germinal L but , which cannot be in time for reproduction, amongst the 
also the backward transmission from the terminal to the . ra - error packets. ; ~ 
distribution. server.. . .. ... , . . _ : <■ c -\:*-r- [0057] ^Hereinafter/ embodiments of the present 

[0049] ' Further, in the present invention, ^ : \ , 

real-time transmission, T control of -transmission " 

(Quality of Service) in the relay server is realized. - r ;^j[Embodiment 1] a r 

[0050] : Next, the sumrrary of realtime jTetransmis-v. is : \L * - 

sion control in the data transmission method of the [9058] s Figures 1-3 are diagrams for explaining a 

present invention will be briefly described.- p : data transmission. method according to a first embodi- 

[0051] . V\^ile,thereaJ-time retransmission cor^ 

the present invention regards.the transmission quality of , ... .[0059] dn the data transmission ^method of this first 
the radio section, and recovers error packets due to 20 embodiment data transmission from the transmitting 
radio transmission error by retransmission of the pack- end to the receiving end, is continuously performed in 
ets, the conventional retransmission control js directed - units of packets; each packet having additional irrforma- 
to realize high-reliability in data transmission (error-free . tion relating to its sequence number, priority and data 
transmission). That is, in order to recover all error pack-,, reproduction time at the receiving end, while succes- 
ets, retransmission of error packets is : .repeated until ^25 sively reproducing data of packets received at the 
data are correctly-transmitted to *the receiving end. .In / receiving end: At this time, only error packets the priori- 
the conventional retransmission control, when^the final .ties of which are equal to or higher than a predeter- 
error packet retransmission hasiailed, the data trans-; mined value are retransmitted, 
mission is abnormally ended as a communication error. : , : / [0060] Figure 1(a) is a. block diagram illustrating a 
[0052] By ? the way, in the retransmission control so data transmission apparatus 101 in a data transmission 
required for the real-time ykieo data transmission.ceven. . system which performs real-time data transmission 
when a transmission error occurs while predetermined ; •* . according to. the data transmission method of the first 
packets are transmitted and thereby several iframe&ot : -embodiment ^ ; ; > a ' , 

images are tost, this is not a fatal transmission: error : £p ;{0061J : This . data transmission apparatus 101 con- 
which leads to abnormal end of data transmissions <-.>, 35:,^ strtutes a^reiay-server (transmitting end) which relays 
Accordingly, in the video data transmission method, to: - ■ data transmitted between a distribution server and a ter- 
complete real-time transmission with a measure of reli- , : minal (receiving end). This apparatus .101 includes a 
ability is given the highest priority. ; * , 01 y cv.;r ^receiving unit 11, a transmission queue management 
[0053] For example, in transmission of a video sig- ■ . unit 12, and a .transmission unit: 13. The receiving unit 
nal based on MPEG; standard, in the case, where a 40 f 11 receives packets transmitted from the distribution 
packet corresponding to an I frame (intra-frame coded server. The transmission queue management unit 12 
image) as a reference image becomes an error packet; - sets the transmission order of the received packets and 
even when subsequent packets corresponding to a_P - the packets to be retransmitted (hereinafter referred to 
frame (inter-frame forward-prediction coded image) and. . as retransmission packets) in accordance with the 
a B frame finter-frame bidirectional -prediction, coded .45 above-described additional information. The transmis- 
image) are received , normally, video signals of the P - sion unit 13 transmits the packet data in the transmis- 
frame and the B frame cannot be reproduced. So, as for sion order which has been, set by the transmission 
the I frame, it is necessary to recover the transmission queue management unit 12. 

error to the utmost [0062] Each packet transmitted from the transmit- 

[0054] Further, in video transmission (stream type so ting end is composed of a data section containing digital 
communication having an audio signal and a video sig- data such as video data, audio data, and text data, and 
nal as objects to be transmitted), in contrast with the . a header section containing additional information other 
conventional retransmission control, it is necessary to . than these digital data. To be specific, the header sec- 
perform retransmission while . performing; real-time ' tion of each packet contains additional information relat- 
transmission. ss ing to its sequence number, priority, and data 

[0055] In order to realize such , real-time transmis- - reproduction time at the receiving end. 
sion, the present invention provides a real-time trans- . [0063] Further, the data transmission * apparatus 
mission method in which the following retransmission 101 includes a buffer 17 for retransmission (hereinafter, 
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referred to as a retransmission buffer 17), a packet pri- 
ority decision unit 15, and a retransmission t^ernt^n-^ 
agemerrt unit (1,8, .retransmission buffer- 17 stores 
predetermined packets arpongst-the. received packets/ 
as retransmission packets. The packet priority decision - 
unit 15 decides-ithe priorities of. the received packets.*- ... 
The retransmission buffernrr^nagemem u a it 18 controls - 
the retransmission buff ©r^ 17 such that data of packets^,; 
the priorities of which are equal .to or higher .than a pre- - 
determined value are stored in the buffer 17, in accords: 
ance with the decided priorities of the packets. To be 
specific, only. when data of a packet having a sequence ~ 
number indicated by a retransmission request from the c 
receiving side is stored in the retransmission buffer 17, 
the retransmission decision unit 16 decides that data<cf 1 >t$ 
this packet should be retransmitted to the receiving end. 
[0064] Further, , the data transmission apparatus r - 
101 indudes a retransmission-instruction receivlngAinit' ' 
14 and a retransmission decision unit 16. The retrans^! k ' 
mission instruction receiving unit 14 receives* a retrarte- zo 
mission instruction (hereinafter also referred te^asr. a ttioi 
retransmission request) from the terminal at the receive 4 : " 
ing end. The retransmission decision unit 16 ; decides c : 
whether retransmission of a packet for which, the ' 
retransmission instruction has been made is-performed '■■ 26 
or not : *tc o> 

[0065] While in figure 1(a) the data transmissions 
apparatus 101 constitutes a relay server, when the data* 
transmission apparatus is a distribution server^ it is con- n 
structed as shown in figure 1{b): That is, in figure 1(b), 
the receiving unit 1 1 of the data transmission apparatus 
101 is replaced with a coded packet generation unit 10a 
which encodes the data and outputs thecoded data-in- 
packet units, and a priority allocation unit 10b which 
allocates additional information such as a:priority v to 
each packet output from the coded packet generation;: 
unit 10a. y r \ .*. .v, - 

[0066] Rgure 2 is a block diagram illustrating;a<datar 



receiving apparatus 201 in the data transmission sys- 
tem which performs real-time'data transmission accord- . ,3o 
ing to the data transmission method, of the first - 
embodiment. . . - : r u 

[0067] The data receiving apparatus 201 includes a ^ 
receiving unit 21 , an error packet detection un^22, and < 
a packet decoding unit 23.r The ^ receiving untt*21. 45 
receives the packets transmitted from the relay server . - ?- 
(the data transmission apparatus at .the transmitting -*v 
end): The error-packet detection unit 22 detects error < . 
packets in which errors have occurred during transmis- 
sion, and outputs normal packets which have been so 
transmitted, without transmission errors. The packet 
decoding unit 23 receives the normal packets and 
decodes the coded data of the norma! packets. 
[0068] Further, the data receiving apparatus 201 
includes a reception history management unit 24, a ss. 
packet priority decision unit 25, and a retransmission 
instruction output unit 26. The reception history man- . 
agemerrt unit 24 manages the packet reception history. 
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The packet priority decision unit 25 receives the result 
^ of the detection iri-fhVerror packet detection unit 22 and 
.''decides an error packet the priority of which is equal to 
or higher* than a predetermined value. The retransmis- 
-..sion instruction^ output unit 26 'outputs a request for 
. retransmitting the error packet which has been decided 
in the packet-priority decision unit 25, toward the trans- 
mitting end, by indicating the sequence number of the 
error packets 

[0069] : Next, the function and effect 'will be 
' described. * * r " 

f0070] Rgure 3 is a sequence chart for explaining 
-the packet selective retransmission control in the data 
transmission method of the'f ifst embodiment- - " " - * 
" [0071 ] In thexlaf a transmission method of this first 
embodiment when an transmission error occurs during 
packet transmission, retransmission request is made 
16r only the packets the^ priorities of which are equal to 
$or higher than a'predetermined Value, from -the receiv- 
ing end tb the transmitting end, ; whi!e u no retransmission 
request is made for the error packets the priorities of 
j which are lower than the predetermined value, - 
10072] For examplepa&umirfg that' the "priorities 
" equal to ortiigher than the predetermined value are ' 
'high priorities while the priorities lower than the "prede- 
i$ termiried value are-low priorities,^ when ! an error occurs 
"during transmission of* a high priority packet (S1) of 
" sequence number S1 , a retransmission request for this 
high priority, packet (S1) is made. However, when an 
90 V error occurs during transmtssion of a low priority packet 
' r: (S2) <of 'sequence number S2, no retransrrtission 

- «k request is made for this low priority packet (S2). / 

- ^ [0073] >To be specific, each packet transmitted from 
the distribution server is given "additional information 

& -v. relating totits sequence number and priority; In the data 
c- ^ transmission apparatus 1-OVasia relay server, the trans- 
it: :,r mission ocderof thereceived packets is set by the trans- 
mission queue: management unit 12, and the packets 



?»aare supplied to the transmission unit 13. Oh the other 
hand, the priorities of the received packets are decided 
by the packet priority decision unit 15. Then, in the 
transmission unit 13, transmission of these packets is 
performed according to the transmission order which 
has been set ^Further, those packets the priorities of 
which are-decided as being equal to or higher than the 
predetermined value are stored in the retransmission 
buffer 17 under; control ; of the retransmission buffer 
management unit 17/* Further, in the retransmission 
buffer 17, data are successively released (discarded) 
from the packets which cannot be in time for reproduc- 
tion, under control of the management unit 18. 
[0074] ..When the retransmission buffer 17 has no 
more vacant space (capacity), one of the following two 
processes is performed: a first updation process in 
which the above-described retransmission data is 
retained while the data of the packets stored in the 
retransmission buffer 17 are discarded in order starting 
from a packet of the earliest reproduction time; and a 
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second updation process in which the retransmission . 
data is retained while successively discarding the data 
stored in the retransmission buffer 1 7 so that reproduce 
tion of packet data for predetermined packets, amongst 
the packet of the -earliest reproduction time and the sub- 
sequent packets, is performed at regular intervals at the ? 
receiving end. 

[0075] ' Jn this way, the packets from the distribution 
server are successively transmitted to the terminal (data 
receiving apparatus) 201 through the relay server (data 
transmission apparatus) 101. " T. 

[0076] In the data receiving apparatus 201, the 
packets from the relay server (data transmission appa- 
ratus) 101 are received by the receiving unit 21 . and the ,. 
received packets are supplied to the error packet detec- ■ 
tion unit 22. Then, only, the packets which have been 
transmitted without transmission errors are output from 
the error packet detection unit 22 to the packet decoding 
unit 23, and the additional information of each packet is 
supplied to the reception history management unit 24. 
At this time, the priority information of each error packet 
is supplied to the packet priority decision unit 25; 
wherein it is decided whether or not the priority of the 
error packet is equal to or higher than a predetermined 
value. With respect to the error packet the priority of 
which is equal to or higher than the predetermined 
value, the retransmission instruction output unit 26 out-- : 
puts a retransmission request-to the transmitting end, 
by indicating the sequence number of this error packet • 
[0077] Then, in the data transmission apparatus 
101 at the transmitting, end, the retransmission request 
is received by the retransmission instruction receiving 
unit 14, and it is decided by the retransmission decision 
unit 16 as to whether the packet of 4 the sequence- : 
number indicated by the retransmission request is: 
stored in the retransmission buffer 17 or<noT When~thd~ 
packet of the sequence number indicated by - the 
retransmission request is' stored in the retransmission ' 
buffer 17, this packet is output as a retransmission 4 
packet, from the retransmission buffer 17 to the trans- 
mission queue management unit 12. In the transmission: 
queue management unit 12, the retransmission packet 
is given a predetermined transmission order and then 
retransmitted to the receiving end through the transmis- 
sion unit 13. i ^ ' 
[0078] As described above, according to the first 
embodiment of the present invention, data transmission 
from the transmitting end to the receiving end is contin- * 
uously performed in units of packets each having addi- 
tional information relating to its sequence number, * 
priority, and data reproduction time and, simultaneously, 
data of the packets received at the receiving end are 
successively reproduced. With respect to error packets 
affected by transmission errors, only those having prior- 
ities equal to or higher than a predetermined value are - 
retransmitted. Therefore, the transmission quality of the ' 
radio section in the real-time transmission is improved 
and, moreover, the number of retransmission times can 
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be reduced. : - •■-■-»- 

£0079] . In this first embodiment, each packet may be 
given the frame type, such as I frame, P frame, and B 
frame, as the additional information, instead of the prior- 
ity, v: - ■ - - - - 
[0080] Further, there are various methods for decid- 
ing the packet priority. For example, in the case of a 
video signal based on the MPEG standard, packets cor- 
responding to I frames may be decided as high priority 
packets. . . i?-' ' 
[0081] - Further, in the packet discarding process 
performed when the retransmission buffer is filled to the 
capacity, the above-described first or second updation 
process may be performed on the packets in the order 
of ascending priorities. 
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[Embodiments] : 

[0082] Rgures 4-5 are diagrams for explaining a 
data transmission method according to a second 

- embodiment of the present invention. 

■ : [0083] r Figure 4 is a block diagram illustrating a data 
transmission apparatus 102. in a data transmission sys- 
tem which performs real-time data transmission accord- 

^ ing to this data-transmission method. 
[0084] ' - The data transmission apparatus 102 
includes an error correction unit 31 , in addition to the 

■ constituents of the data transmission apparatus 101 of 
the first embodiment. The error correction unit 31 per- 
forms an error correction process in which each packet 
output from the transmission queue management unit 
1 2 is given error correction codes for additional informa- 
tion such as its sequence number, priority, etc., and the 

' packet which has been subjected to the error correction 
process is supplied to the transmission unit -13. Other 
constituents of the data transmission apparatus 102 are 
identical to those of the data transmission apparatus 

: 101 of the first embedment * 
[0085] Rgure 5 is a block diagram illustrating a data 
receiving apparatus 202 in the data transmission sys- 
tem which performs the real-time data transmission 

' according to the data transmission method of this sec- 
ond embodiment - 

[0086] The data receiving apparatus 202 of this 
second embodiment includes' an error correction unit 
41, in addition to the constituents of the data receiving 
apparatus 201 of the first embodiment The error cor- 
rection unit 41 performs an error correction process in 
which each packet received by the receiving unit 21 is 
subjected to an error correction process in which the 
additional information of this packet is subjected to error 
correction by using the error correction codes given to 
: the packet, and the packet which has been subjected to 
the error correction process is output to the error packet 
detection unit 22. Other constituents of the data receiv- 
ing apparatus 202 are identical to those of the data 
receiving apparatus 201 of the first embodiment 
[0087] Next the function and effect will be 
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described, packet is embedded in the subsequent packet which is 

[0088] In the data transmission method according transmitted next to this packet, a transmission request 
to the second embodiment, at the transmitting end, v 'oJpr this error €packet {predetermined packet) can be 
each packet to be transmitted is given error correction " vipade correctly. 

codes for the additional -information relating, tor -its . 5. 1^0094] -While in this third embodiment the additional 
sequence number, priority, etc. At the receiving end, the information of r each packet is' embedded in the next 
additional information is subjected to errdr. correction :. ' 1 packet, rfrnay be embedded in, not only the next packet, 
according to the error correction codes and; -thereafter,-? tr- ^ but also a plurality of subsequent packets. This con- 
a retransmission request for the error packet is made in- destruction willbe described hereinafter as a modification 
accordance, with the : additional information.. Thereto w - of the third'embodrment. t ^ : 
even when the sequence number and the priority infer-. v; 1 « * ■* 

mation have errors, : ra retransmission request foc^he ^^Modification of Embodiment 3] &v 
error packet can be correctly performed. v .."T - < - t • - r . ^ m 

u _ - A-ij :,.[G095] Figure 7is a block diagram illustrating a data 

[Embodiment 3] - : - - * *r~: -rr^vtransmissiontapparatus 103 in a-xiata transmissionisys 1 - * 

i-yr.z T."Yr*r v tern awhictv performs real-time -data transmission by 
[0089] Figures 6-9 are diagrams for explaining 
data transmission methods according to a third embody 
imerrt of the invention and a modification of the third 
embodiment. Figure 6 is c a sequence diagram %r '20, 
explaining packet selective retransmission control Jn^the^r 
data transmission method of the third embodiment. ;* 
[0090] In the data transmission method of the^hird 



embodiment, at the transmitting end, additional informa- 
tion relating to the sequence number and priority: of a 
predetermined packet is embedded, in- a subsequent 
packet which will be transmitted after the predetermined 
packet At the receiving end; when a transmission error 
of the predetermined packet occurs and thereby the 
additional information of the predetermined packet has 
an error, a retransmission request for the error packet is 
made when receiving tho subsequent packetwhiohr is 



using a data transmission method according to the 
modrfication of the third embodiment. 
[0096] - The : data • transmission . apparatus r 103 
deludes a sequence number storage unit 33 and a 
sequence number insertion unit 32, in addition to the 
,'u" : ^constituents. of the data transmission apparatus 101 of 
:the first embodiment The sequence number storage 
w\ unit 33 stores dthe sequence numbers of the packets this * 
-25 r priorities of which are equal to or higher than a predeter- 
: r mined value, amongst the /packets transmitted by 'a 
transmission unit. 13a. The sequence number insertion ■ 
* m unit 32 outputs each of the sequence numbers stored in 
.-'rs -.the sequence number storage unit 33 to the transmis- 
&o - sion unit 1 3a so that the sequence number is inserted in 
- - the header of the packet to bs transmitted. Further, the 



transmission unit 13a of this modification is different 
transmitted after the error, packet <in accordance rwithv. r. from the transmission unit 13 of the first embodiment 
the additional information of the predetermined packet ^ snly in that it inserts , the sequence' number supplied 
which is embedded in the subsequent packet; ^ -ly.r.* ps yfrpm the ?qequence number ^insertion unit 32 into the 
[0091] / For example, -assuming; that the,^ priorities c^ t o, header of the packet supplied from <£he transmission 
equal to or higher than a predetermined valtie,are':high y ^i;c -).queue management- unit 12, before transmitting the 
priorities- while Jhe priorities lower than the predetep- . : packet. Other^ -constituents of the data transmission 
mined value are low priorities, as shown, in figure 6**; t: n apparatus. 103 are identical to those of the data trans- 
when an error occurs during transmission of a high pri- 40 



orrty packet (S1) of sequence number S1 and only a low 
priority packet ($2) of sequence number S2 which fol- 
lows the packet SI is. normally received, a retransmis- 
sion request for the high priority packet (S1) is made 
when the next low priority packet (S2) is received^., t 
[0092] • On the other hand,, when an error occurs 
during transmission, of a low priority packet (S3) of 
sequence number S3 and only a high priority packet . 
(S4) of sequence number S4 which follows the packet 
S3 is normally received, no retransmission request for 
the low priority packet S3 is made when the next high 
priority packet (S4) is received. 
[0093] In. the : data transmission method so con- 
structed, even when an error occurs during transmis- 
sion of a predetermined packet and thereby the 
sequence number or the priority information of ttiis 
packet has an error, since the additional information 
(sequence number, priority, etc.) of the predetermined 
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'mission apparatus 101 of the first embodiment 
[0097] f Figure 8 is a block diagram illustrating a data 
receiving -apparatus 203 in the data transmission sys-. 
tern which performs the read-time data transmission by 
using the data transmission- method according to the 
modification of the third embodiment - ^ 
[0098] The data receiving apparatus 203 according 
to the modification of the third embodiment includes an 
inserted sequence extraction unit 42, in addition to the 
constituents of the data receiving apparatus 201 of the 
first embodiment. The inserted sequence extraction unit 
42 extracts, from a normal packet output from the error 
packet detection unit 22, the sequence number of a high 
priority packet which has been received in advance of 
the normal packet The normal packet is output to the 
packet decoding unit 23 through the inserted sequence 
extraction unit 42. Further, in the data receiving appara- 
tus 203, the packet priority decision unit 25a outputs a 
retransmission request to the retransmission instruction 
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output unit 26 when the packet of the sequence number 
extracted by the inserted sequence extraction. unit 42 is 
an error packet. Other .constituents of the data receiving 
unit 203 are identical to those of .the data receiving 
apparatus 201 of the first embodiment 
[0099] Next, the function and effect will:, be 
described. _ . 

[0100] Figure 9 is a sequence diagram for. explain- 
ing packet selective retransmission control in the data 
transmission method according to. the modification of 
the third embodiment v. : 

[0101] In the data transmission apparatus (trans- 
mitting end) 103, in addition to the transmission opera- 
tion of the data transmission apparatus 101 according 
to the first embodiment, the process of embedding the 
sequence number of a high priority packet to be trans- 
mitted in the subsequent packets, is carried out until the 
next high priority is transmitted. - . " ^ 

[0102] For example, assuming that the priorities 
equal to or higher than a predetermined value are high 
priorities while the priorities lower, than the predeter- 
mined value are low priorities, as shown in figure 9, after 
a high priority packet (S1) of sequence number S1 has 
been transmitted, subsequent packets (S2)~(S4) of 
sequence numbers S2-S4 are transmitted after the 
sequence number S1 of the previous high" priority • 
packet (S1) is embedded therein, and then a high prior- 
ity packet (S5) of sequence number S5 is transmitted 
after the sequence number S4 of the previous high pri- 
ority packet (S4) is embedded therein. 
[0103] When an error occurs while the high priority 
packet (S1) and the subsequent low priority packets 
(S2) and (S3) are transmitted and so only the high prior- r 
ity packet (S4) is normally received, a retransmission 
request for the first high priority packet S1 is rtiade when 
the next high priority packet (S4) is received. :^ !r *-. - 
[0104] ' Further, in the data receiving apparatus 
(receiving end) 203, in addition to the receiving opera- 
tion of the data receiving apparatus 201 of the first 
embodiment; the following retransmission is performed. 
That is, when the sequence number embedded in the 
received packet is extracted, if the packet correspond- 
ing to this sequence number is an error packet a packet 
retransmission request is sent to the transmitting end by 
using the sequence number of this packet ' ' - 
[0105] In the data transmission method according 
to the modification of the third embodiment, at the trans- 
mitting end, the process of embedding the sequence 
number of a high priority packet, the priority of which is - 
equal to or higher than a predetermined value, into the 
subsequent, packets which follow this high priority 
packet is continued until a high priority packet next to 
the high priority packet is transmitted. At the receiving 
end, the sequence number of another packet (high pri- 
ority packet) embedded in the received packet is 
extracted. When this packet (another packet) is an error 
packet, a retransmission request for this packet is made 
by indicating the sequence number of this packet 
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-Therefore, even when two successive packets become 
> error packets, the sequence number of the high priority 

- packet which has become an error packet can be 

* detectedfrom the header information of the subsequent 
; packet which is transmitted without a transmission error, 

whereby a retransmission request for the high priority 

- error packet can be made with higher reliability. 
[0106] * In the third embodiment, the sequence 
number ; arid priority information of each packet are 
embedded in the header of a packet to be transmitted 

; next to this packet and in the modification of the third 
■ embodiment the sequence number erf a high priority 
r packet to be transmitted is embedded in the subsequent 
r plural packets until the next high priority packet is trans- 
mitted. However, the information to be embedded in the 
subsequent packet is riot restricted thereto; For exam- 
ple, the number of retransmission times may be embed- 
ded in the subsequent packet together with the 
sequence number.' ""'- J 

[0107] -In this case, at the transmitting end, informa- 
tion relating to the number of retransmission times is 

- embedded in each packet together with the sequence 
number. At the receiving end, when making a retrans- 
mission request for an error packet, the' number of 
retransmission times and the sequence number corre- 

i sponding to the error packet are paired arid indicated to 

- the transmitting end. At the transmitting end, a selective 
retransmission process is performed as follows. That is, 

* ■ retransmission of the error packet for which the retrans- 
mission request has been made is performed when the 
data of the packet 'having the sequence number indi- 

< cated by the retransmission request from the receiving 
: end is stored in the retransmission buffer and there is 
■r '^fratching -in the number of" retransmission times 
.321 ■ 'Between' - the 'packet "for which the retransmission 
^ ' request is made and the packet which is stored in the 
- buffer and has the identical 'sequence number. Then, 
. the number of retransmission times of the retransmitted 
packet in the retransmission buffer is incremeted. 
40 [0108] - Hereinafter, a specific ; construction for 
embedding the number of retransmission times (herein- 
after also referred to as retransmission count) in the 
subsequent packets will be described as a fourth 
embodiment of the invention. 
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[Embodiment 4] - ■ ' 4 

[01 09] Figures 10-15 are diagrams for explaining a 
data transmission method according to a fourth embod- 
iment of the present invention. 
[Q110] Figure 10 is a block diagram illustrating a 
data transmission apparatus 104 in a data transmission 
system which performs real-time data transmission by 
the data transmission method according to the fourth 
embodiment 

[0111] The data transmission apparatus 104 
includes a sequence number/retransmission count stor- 
age unit 35, a sequence number/retransmission count 
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insertion unit 34, and a retransmission count clear unit 
38. The, sequence nurrtoer/retransmission -count stor-: 
age unit 3& -stores the sequence -numbers and the. 
retransmission counts, of: the packets the priorities- of 
which are equaljjto or higher than a .predetermined 
value, amongst the packetetransmitted by the transmis* 
sion unit 13a. The sequence number/retransmission : 



[0114] In figure 10, the sequence number/retrans- 
mission count increment unit increments the retrans- 
.- / mission count (number of retransmission times) of the 
,-> .', packet in the retransmission buffer 17a, which packet is 
rs ^ decided to be retransmitted by the retransmission deci- 
il* sion unit 16a. • 

-[0115] i r; Other constituents of the data transmission 



count insertion unit 34 outputs th* sequence numbers apparatus 104 are identical to those of the data trans- 
and the retransmission count which are stored in the r ." Mission apparatus of the first embodiment ^ * 
storage unit 35,. the transmission gnit 13a, syclr that ,.. 10 .,[0116] h: Figured* is a block diagram illustrating a 
these data are inserted in the header- of the packet to be : ~ - - ^ B receiving apparatus 204- in the data transmission 
transmitted. The retransmission count dear unit 38 sub- 0 t system which performs the real-time data transmission 
jects the packet recced # th : e receiving unit 1 1 ft* a- . ^ : .according to the data transmission method of the fourth 
process of clearing Jhe retransmission count.and put-, .embodiments - * „. ■< - 

puts the packet to. the transmission queue nrwnagem^. c 75^ [0117] v r The data: receiving unit 204 of* this fourth 
unit 12. Further, the transmission unH43aotthis fourth. . fi ... embodiment .includes a retransmission -instruction out- 
embodiment is different jh function from the jtransmte- P ; Jupu t unit 56a; 1 instead of the v retransmission instruction 
sionunrt13ofthefii^et£j^m £ output unit !26 of; the data receiving apparatus 203 

the sequence pumber and the retransmis^pn, count ^ >; according to the modification of the third embodiment, 
supplied from the sequence number/retransrrt^ic«i. ff;/ g)0;^jhe retransmissfon instoictionioutput unit;206a outpite 
count insertion unit34 into the header Off the packet«up- r> . a retransmission instruction which requests retransmis- 
plied from the transmission queue management unij 42^ sion of a packet by using information in which the 
and then transmits^this packet ... ~ ..^ ^ . - sequence number c and retransmission; count of this 

[0112] The data transmission apparatus 104 further •■> > j> - . packet are paired „ *^ t ^ 
includes a sequence number/retransmission -count 2$ -[01 18] v. Other constituents of - the idata receiving 
comparison unit 3$ which receives the retransmission / ^apparatus 204 are. identical. to those of the data receiv- 
instruction. received by the retransmission: instruction r -re- ing apparatus -203 accorcfing to the modification of the 
receiving unit T4 (La, -the sequence - number^ and ^ third embodiment. o: 

retransmission count of the packet to be retransmitted) :[0119] ■ Next the function j and effect will be 
through the reproduction decision unit 16a,*: and comr- 30 r^lescrtoed. ..v L 

pares the sequence number of the packetfojc- which the ; ^ [0120] Figure 12 a sequence diagram for explaining 
retransmission request has. been made: wjtho the iv packet selective retransmission control in the data 
sequence numbers of the packets stored. inthe retrans-/^ — -transmission method of the fourth embodiment, illustrat- 
mission buffer 17. Further,- it compares : the .retransmis?a , ing a first example of data .exchange betweervthe trans- 
sion count of tha packet for: which th^ retransrnissiorjri-35 mitting end and the receiving end., v •<-•-<> - 
request has beervmade with the retransmissipn eountof ,[0121] l t y lrv the state shown in figured 2, the high pri- 



the packet which is . stored in, the retransmissiorv buffer 
17 and has the ^sequence number indicated by-tiie : 
retransmission request ,. ■*, *n 

[01 1 3] In the data transmission apparatus 1 04, the 
retransmission decision unit 16a decides retransmis- 
sion of packets as follows, in accordance with the output , 
from the comparison unit 36. To be specific, when the 
sequence number of the rearmost packet which has 
been received most recently is larger than the sequence 
number of the error packet, it is decided that selective 
retransmission should be performed on the. error 
packet On the other hand, when the sequence number 
of the rearmost packet is smaller than the sequence 
number of the error packet, it is decided that selective 
retransmission should be performed on a packet having 
a sequence number which is larger than the sequence 
number of the rearmost packet and equal to or smaller 
than the sequence number of the error packet Further, 
the retransmission buffer 17a outputs the packet to be 
retransmitted, to the transmission queue management 
unit 12, in accordance with the result of the decision in 
the retransmission propriety decision unit 1 6a. 
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,orrty packet of sequence number S1 has already been . 

; .received .-oqcroally. at the receiving end. Hereinafter, a 

: packet having a sequence number Sn and retransmis- 
sion count-N is represented as a packet (Sn,N) [n,N: 
natural numbers]. In the figure,; packets of sequence 
numbers SI, S2, and S4 are high priority packets, and 

' packets of sequence numbers S3 and S5 are packets 
other than thev high, priority packets. In this fourth 
embodiment ;,-pnly the additional information of the 
above-mentioned high priority packets are embedded in 
the subsequent packets. - r, .. 
[01 22] : Initially, as shown in figure 1 2, at a predeter- 
mined transmission timing, the high priority .packet: 
(S2,1) subsequent to the high priority packet (S1) is 

•retransmitted. At this- time, in the header of the packet 
(S2,1), the sequence number S1 and retransmission 
count 1 of the=high priority packet (S1) are embedded as 
well as its sequence number S2 and retransmission 
count 1. 

[0123] At the next transmission timing, the packet 
• <S3) subsequent .to the high priority packet (S2.1) is 
transmitted, having, in its header, the sequence number 
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S2 and retransmission count., 1 ojL the high priority performed in response to, the retransmission request for 

packet (Sj?,iXas ; well as its s^uence humher S3. -V Jhehighfyiorrty pa(^ (^J). , , ^ , - 

[0124] At the next transmission timing, the next high [0132] , , : Next, another example of data exchange will 

priority packet (S4.1) is retransmitted, haying, in its • be described by using a sequence diagram of figure 13. 

header, the sequence number S2 and retransmission 5 > [0133] In the case - shown in. figure 13, data 
count 1 of the.high priority packet (S2.1) as well as its ; . : .- ( exchangg : from transmission of the high priority. packet 

sequence number S4 and retransmission count 1 . (S2, 1 ) to transmission of the high priority packet (S2.2) 

[0125] . At the . next transmission timing,, the next ■ , ; r is identical to that described with respect to figure 12. 

packet (S5) is ^transmitted, having, in its- header, the <~ [0134] .. 7 ln : the,case shown-in figure 13 r , transmission 

sequence number S4 and retransmission count j of tfte f"o fj of the high priority packet (S2.2) is error transmission, 

high priority. packet (S4,1) as. well as its sequence ^and the next high priority packet (S4.2) ^ normally 

number . .> . ,- r — L received. « ,. : - ? ,:-. t . . v v.. 

[0126] jn the above-described four times of packet ... i; 10135] . In this case, at the receiving end, rt is known 

transmission, a transmission error has occurred during ; ,. that the high priority packet which has been received 

the first to third packet transmission and, therefore, the r5 most recently has. the sequence number S4, and the 

packets (S2,1), (S3), and (S4) are not received at the , error packet has the sequence number S2 and the 

receiving end while only the packet (S5) is received. . retransmission count .2. 

[0127] , r In.this istate, at the. transmitting end, it is^ ;0 .i s [0136] v . So, the receiving end sends a retransmis- 

known that ..the . high .priority, packet which has been , , .. sion request for the.high priority packet (S2.2), together 

received most , recently -is the ..packet haying the 20 with the sequence number S4 of the most-recentty 

sequence number S1 , and the error packet is the packet received high priority packet as well as the sequence 

having the sequence number S4 and the retransmission . . number S2 and retransmission: count 2 of this packet 

count 1, but ft is not known what kinds of packets^ have , ,,(S2,2). : ; . - 

been transmitted between the high priority packet (S1) [0137] ■ Then, atthe transmitting end, the sequence 

and the packet (S5). 2s number S4 of the most-recerrtly received high priority 

[01 28] So, the receiving end sends a retransmis- packet is compared with the sequence number S2 of the 

sion request for the high priority packet (S4.1), together . • error packet for which , the retransmission request has 

with the sequence number S1 of the most-recerrtly T - s been made.. In this case, since the sequence number 

received high priority packet as well, as the sequence S4 of the most-recerrtly received high priority packet is 

number S4 and retransmission count 1 of this packet so larger then the sequence number S2 of the error packet. 

(S4.1). T . . % .the transmitting end performs selective retransmission 

[0129] Then, at the transmitting end.the sequence ~ - .for only the. error packet 

number SI of the most-recerrtly received high priority ; - [0138] That is, the high priority packet (S2,3) is 

packet is compared with the sequence number S4ofthe . - > .transmrtt^d, having, in its header, the sequence number . 

error packet for. which the retransmission request has 35 S4 and retransmission count 2 of the high priority 

been made. In this case, sinc^ the sequence^ . i ; 

the most-recently received high priority. packet is [9139] .Next still another example of data, exchange 

smaller than the sequence number of the error packet, will be described by using a sequence diagram of figure, 

the transmitting end performs selective retransmission . fj 14. /( r - .v -- * y. \ . 

for those packets having sequence numbers larger than 40 [0140] .. Initially, as shown in figure 14, at a predeter- 

the sequence number SI and equal to or smaller than mined transmission timing, the high priority packet 

the sequence number S4. • (S4,1) is retransmitted, having, in its header, the 

[01 30] In this case, the high priority packet (S2.2) is - sequence number S2 and retransmission count 1 of the 

transmitted, having, in its header, the sequence number .high priority packet (S2,1) which has been transmitted 

S4 and retransmission count . 1 of the high priority 4S in advance of this packet as well as the sequence 

packet (S4,1) and, subsequently, the high priority . number S4 and retransmission count 1 of this packet 

packet (S4.2) is transmitted, having, in its header, the ; [0141] . At the next transmission timing, the next 

sequence number S2 and retransmission count 2 of the - , packet (S5) is transmitted, having, in its header, the 

high priority packet (S2,2). . sequence number S4 and retransmission count 1 of the 

[0131] . On receipt of the high priority packet (S2.2), so high priority, packet (S4,1) as well as the sequence 

the receiving end sends a retransmission request for number S5 of this packet 

the high priority packet (S4.1) toward the transmitting . [0142] , In this example, a transmission error has 

end, together with the sequence number S2 of the - occurred during the first packet transmission, and so the 
most-recerrtly received high priority packet. (S2,2) as- : - packet (S4,1) is not been received at the receiving end 

well as the sequence number S4 and retransmission : 55. while only the packet (S5) is received, 

count 1 of this packet (S4,1). However, with respect to [0143] In this state, at the receiving end, it is known 

the high priority packet (S4), since the second retrans- . - that the most-recerrtly received high priority packet has 

mission has already been done, no retransmission is the sequence number S1, and the error packet has the 
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sequence number S4 and the retransmission count 1. S4 and retransmission count 2 of the high priority 

[0144] ' 'So,- thS receiving end 'sends' a retransmit \ packet (S4;2) as well as the sequence number S2*nd 
sion request for the high priority packet (S4.1); together - : " retransmission count 3 of this packet and, subsecjuentJy, 
with the sequence number S1 " of the most-recently : the high priority packet (S4,3) is transmitted, having, in 
received high priority packet as well as the sequence s - its header, the sequence number S2and retransmission 
number S4 and retransmission count 1 of this packet count 3 of the high priority packet (S2.3) as well as the 

[0145] ' Then, at the transmitting end, the sequence^* sequence number S4 and retransmission-count 3 of this • 
number S1 of the most-recently received high priority*^ packet. *■ - " " z : - c ' 

packet is compared with the sequence number S4 of the 0 ; " r ' " ; [01 53] ; -As described above; according to the fourth 
error packet for which the retransmission request has 10 embodiment when the sequence number of the most- 
been made. In this- case; sfnce the sequence number ' ~ "receiitly received high priority packet is larger than the 
S1 of the most-fecently received high priority packet is f J "sequence number of the error packet'the transmitting 
smaller than the sequence number S4 of the error A '^-iihd retransmits only the error packet. Therefore; 
packet the transmitting end performs selective retrans- - retransmission of this error packet ' can be performed 
mission for those packets- having sequence' numbers M5 >: efficiently. c ' " y 

larger than the sequence' number S1 and equal to br ' - [0154] ' In this fourth embodiment emphasis has ' ' " 
smaller than the sequence nunfcer S4/ -*'\ "-' been placed on the base where" one data receiving ' " 

[0146] In this case, the high priority packet (S2.2) is* - * ' : apparatus is provfided for one data transmission appara- -\ 
transmitted, having, in its header, the sequence nurhber ^ ; 'tius. However, the selective retransmission process of ~ 
S4 and retransmission count 1 of the high priority : 20 '- this fourth embodiment can be applied to multicast havV ' ' " 
packet (S4,1 ) as well as the sequence number S2- arid - ing a plurality of data receiving apparatuses for one data ' r ' 
retransmission count 2 of this packet (S2.2) and, subse- transmission apparatus. Hereinafter, a selective ' 
quentiy, the high priority packet (S4.2) is transmitted; ' '■ " retransmission process applicable to multicast will be ^ 
having, in its header, the sequence number S2 and clescrfoed as a modification of the fourth embodiment' : l r '*' ' 
retransmission count 2 of tho high priority packet ($2,2) 25 *■ . s • = ; : 

as well as the sequence number S4 and transmission - -{Modification of Embodiment 4] 

count 2 of this packet- - : > T v * * ■ < 

[0147] Thereafter, the packet of sequence number [0155] Figure 15is a sequence diagram for explain-' 
S6 is transmitted, having, in its packet the sequence ing a data transmission method according to a modifica- 
number S4 and retransmission count 2 of the high prior- : ' ; 30 ton of the fourth embodiment, illustrating an example of 
ity packet (S4,2) as well as the sequence number S6 of * selective retransmission in the case where a plurality of 
this packet v ^: data receiving apparatuses are provided for one data 

[0148] Since errors have occurred during transmis- <" 'transmission apparatus. ' " 
sion of the high priority packets (82,2) and (S4;2) ( these te- [01 56] Initially, as shown in figure 1 5, at a predeter- * 
packets are' not received at the receiving end, and orily* ^ 'mined transmission timing, the high priority packet v : 
the packet (S6) is received. * '-'"< > ^s-^w^tr^ -^si.1)" is i transmitted; having, in its header, the - : * v 
[0149] In this state, at the receiving end, it is known r - ^^baquence-nurhbef and ^retransmission count of a previ- 
that the most-recently received high priority packet iias \ f >T - ' ous high priority packet as Weil as the sequence number 
the sequence number S1, and the error packet has the ?:j ' S1 and retransmission count 1 of this packet In this 
sequence number S4 and the retransmission count 2. 40 case, there are two receiving ends for the transmitting 
[0150] * So, the receiving end sends a retransmis- v end, i.e., the receiving end I and the receiving end II, 
sion request for the high priority packet (S4.2), together' • and transmission of the high priority packet (S1 ,1) is 
with the sequence number S1 of the most-reCently -error transmission. 

received high priority packet as well as the sequence - [0157] In this case, each receiving end sends a 
number S4and retransmission count 2 of this packet 45 retransmission request for the high priority packet 
[0151] ^ Then, at the transmitting end, the sequence % (81,1); together with the sequence number (lastS) of 
number S1 of the most-recently received high priority 1 the most-recentiy received high priority packet 
packet is compared with the sequence number S4 of the [0158] In response to the retransmission request 
error packet for which the retransmission request has ' from the receiving end I, the transmitting end retrans- 
been made/ In this case, since the sequence number so mits the high priority packet (S1,2). However, after this - 
S1 of the most-recently received high priority packet is retransmission, the transmitting end does not perform 
smaller than the sequence number S4 of the error : -' retransmission in response to the retransmission 
packet the transmitting end performs selective retrans- request from the receiving end II, because the high pri- 
mission for those packets having sequence numbers ority packet (S1.2) has already been retransmitted in 
which are larger than the' sequence number S1 and ss response to the retransmission request from the receiv- 
equaJ to or smaller than the sequence number S4. - ing end II. — 

[0152] That is, the high priority packet (S2.3) is [0159] As the result of the retransmission of the 
transmitted, having, in its header, the sequence number high priority packet (S1.2), the receiving end I receives 
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the high priority packet (S1) while the receiving end II 
does not receive the high priority packet(S1).v ~ - 
[0160] . In this case, the receiving end II outputs a 
retransmission request for the high priority packet 
(S1,2). In response to this request,, the transmitting end 
increments the retransnrdssion count- and retransmits 
the high priority packet (S1 ,3). ; y« ^ f - 

[0161] In the fourth embodiment and the modifica- 
tion thereof, an upper limit may ; be: set for the ^retrans- 
mission count. ^Further, the - upper limit of the 
retransmission count may be changed according to the 
priority value of the packet. v * ,^ , : . — . : , - 

[EmbocDmerrt 5] ---- , ^ ; ^ .r . 

[0162] ^ Figures 16 and 17 are.(Jiagrams for explain- 
ing a data transmissioa method according to a fifth 
embodiment of the prese/rt invention, r t ^> . -i- 
[0163] .; According to the data transmission method 
of this fifth * embodiment, .in the -data transmission 
method of the first embodiment absence of a sequence 
number is detected at the receiving end, and a retrans- 
mission request r for a packet having the absent 
sequence number is made by using this sequence 
number. At the transmitting end, when the packet of. the 
sequence number for which the retransmission request 
has been output from the receiving end is storedtin the 
retransmission buffer 17. retransmission, of this-pccket 
is performed. At the transmitting end, only, high priority 
packets are stored in the retransmission buffer 17. 
[0164] Figures 16(a); and 16(b) are block diagrams 
illustrating a data transmission apparatus 105 and a 
data receiving apparatus. 205, respectively, in a data 
transmission system which performs real-time data 
transmission by the data transmission method r of this 
fifth embodiment - - ^ > ;vj c 

[01 65] The data transmission apparatus 1 05 is 
identical in structure to thedata transmission apparatus 
101 of the first embodiment:. The data receiving appara- 
tus 205 includes a receiving unit 21, an error packet 
detection unit 22, a packet decoding .unit 23, and a 
reception history management unit 24,. like the data 
receiving apparatus 201 of the first embodiment. The 
receiving unit 21 receives packets transmitted from a 
relay server (data transmission apparatus at the trans- 
mitting end). The error packet detection unit 22 detects 
an error packet in which an error has occurred during 
transmission, in accordance with the output from the 
receiving unit 21 , and outputs a normal packet which 
has been transmitted without a transmission error. The 
packet decoding unit 23 receives the normal packet to- 
decode coded data of the normal packet The reception 
history management unit 24 manages the reception his- 
tory of packets. 

[0166] The data receiving apparatus 205 of this fifth 
embodiment has a . retransmission instruction output- 
unit 26b which outputs, a retransmission request for a. 
packet corresponding to the absent sequence number 



: , -detected by thaerror packetdetection unit 22,instead of 
the retransmission instruction output unit 26 of the data 

- , r receiving apparatus 201-of the firsl embodiments 

> i .[0167] r - Next the function and effect wiil be 
*; * described. ; & 

^£0168] - • Figure 17 is a sequence diagram for explain- 
ing packet selective^ retransmission control in the data 
! ..3 .transmission method of this fifth embodiment v y ' 

[0169] ; When a high priority packet (S1)^ of 
• 1Q :, sequence number S1 ..which has been, output from the 
: data transmission apparatus (transmitting end) 105, is 
1 not received by the data receiving apparatus (receiving 
' " rend) 205 due to a transmission error, in the data receiv- 
ing apparatus- 205, the error packet detection unit 22 
15 .detects that the sequence number S1 is absent, and a 
retransmission; request for the packet of this sequence 
: - z number S1 is. output to the transmitting:end. 
: ;> [01 70] ;At the transmitting end, it is decided whether ' 
b the packet of the retransmission request is stored in the 
20 ^retransmission^buffer 17 or not In this case, since the 
c;, -packet of -the retransmission request is a high priority 
packet, it is stored in the retransmission buffer 17. 
- £« i Therefore,, the transmitting end performs retransmission 
-/ c*c,of this packet : v ... .. 

2s -[0171] Further, v when a packet (S2) of sequence 
< : v number S2, which has been output from the data trans- 
:r mission apparatus (transmitting end) 105, is not 
received by. the data receiving apparatus (receiving 
(;end)-205duetoa^transmission error, in the data recetv- 
-30: ing apparatus. 205, the error packet detection unit 22 
. / detects that the sequence number. S2 is absent, and a 

- ^ : . retransmission request for the packet of this sequence 
■•.-"•-*« : number S2 is output to the transmitting end. c • *r 

/. - ,[0172] At the transmitting end, it is decided whether 
35 i the packet of the retransmission request is stored in the 
. . -retransmission: buffer 1 7 or not In this case, since "the 
~ r - packet of the retransmission request is not a high pribr- 
: rity packet, it is not stored in the retransmission buffer 17. 
-Therefore,' the transmitting end does not perform' 
, 40- retransmission of this packet: " 

[0173] ' As described above, according to' the fifth 
~ embodiment of the invention, the receiving end detects 
tiie absence of sequence number, and instructs the 
, transmitting end to retransmit the packet of the absent 
45. . sequence number by using this -sequence number. 
: Then, the transmitting end retransmits the packet of the 
- . ^sequence number indicated by the instruction from the 
receiving ' end when this packet is stored in the retrans- 
. mission buffer. Therefore, the transmission quality in the 
so wireless section in real-time transmission can be 
improved and, furthermore, the number of retransmis- 
sion times can be reduced. 
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[Embodiments] 

[01 74] Figures 1 8-20 are diagrams for explaining a 
data transmission method according to a sixth embodi- 
ment of the present invention. 
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[0175] In the data transmission method of this sixth 
embodiments-data transmission from the transmitting^ 
end to the receiving end is continuously performed In " ^ 
units of packets ^each having additional information ~ 
relating to its sequence number, priority, and data repro- ]$ 
duction time and, simultaneously, data in the packets.; 
received at the recerving >( end ar? successively.repro- r : : 
duced. At this time, only the packet which can arrive at : / , 
the receiving end within -the L tUm limit is, retransmitted. - 
[0176] Figure 18 is a block diagram illustrating a Ho 
data transmission apparatus 1 06 irra data transmission * *; > 
system which performs real-time data transmission "ttf M ' 
the data transmission method of this sixth embodiment 
[0177] . This data vtransipssion apparatus 106 con-? .: " 
stitutes a relay server (transmitting .end) -which relays'- > is 
data transmitted between ^distribution server and a ter * «..:• :• 
minal 9 (receiving end). Jhe.data^nsmissiqaappara-^* i 
tus 106 includes a reproduction time dedsiohunit39, in '3 * 
addition to the constituents of the- data transmission [? 
apparatus 101 rot the first embodiment The reproduc-^: sa; ■ 
tion time decision unit 39 decides a packet which cannot * ~ r <r 
arrive at the receiving end within the reproduction thrtejo < 
amongst the packets to be transmitted. In the transmis* .> 
sion unit 13b, the packet decided in the reproduction v*' -i 
time decision unit 39 is not transmitted to the receivings 25'; 
end whether it is stored in the retransmission^buffer 17 ' 7 
or not - *x -v: . ;r, .-.j^t 

[0178] Other constituents of the data transmission ~ 
apparatus 106 are identical to those of the data trans- 
mission apparatus 101 of the first ambodiment= \ yjx 30. : 
[0179] _ .Figure. 19 is a block-diagram illustrating ar: 
data receiving apparatus 206 in the data transmission l; 
system which performs real-time data transmission.! - ^ 
according to the data transmission method ofthe sixth *!■-.: 
embodiment. ^. , ,^ . . , . * , ; ; ' * ;^ £r 

[0180] - -The-dsta receiving apparatus*20&indudes 
reproduction time decision unit 43, instead of the packet r;a. is-' 
priority decision unit 25 of the data receiving apparatus^ 
201 of the first embodiment. The reproduction.time deck: 
sion unit 43 detects the reproduction time which is given i ft? - 
to the error packet detected by the error packet detec-r •> r 
tion unit 22 and the arrival time of the error packet at the ; ' r 
receiving end, decides the arrival time limit based on the r 
reproduction time, and decides whether or not the error ^ 
packet has arrived at the receiving end before the-arrival 4s- 
time limit. On the basis of the result of the decision, the : 
retransmission instruction output unit 26 instructs tha - 
transmitting end to retransmit the. error packet , which/, 
has arrived at the receiving end before the arrival time: 
limit by using the sequence number of the packet The so 
decision of the arrival time limit by the reproduction time 
decision unit 43 is performed based on at least one of 
the allowable packet delay time which is decided at the 
receiving end, and the packet transmission delay time 
between the transmitting end and the receiving end. - s$ 
[0181] Other constituents of the data receiving 
apparatus 206 are identical to those of the data receiv- 
ing apparatus 201 of the first embodiment 



[01 82] As for the method of deciding the arrival time 
limit it will be described in detail as an eighth embodi- 
ment of the present invention. 
: iD183] Next-' the function ,; and effect will be 
'described.-*- * r ** 

* [01 84] Figure 20 is a sequence diagram for explain- 
ing packet retransmi ssibn '> odritr oi with time limit in the 
.data transmission method accorcfing to this sixth 
-embodiment" ' " ; • v - r - ** - — " '* 
*{0185] ' In the data transmission apparatus (ians- 

• mitting end) 106, $aeh packet to be transmitted is given 
-a reproduction time at the receiving end? * : J '' ' 
f01 86] For example, when high priority packets (S1 ) 
and (S2) having sequence numbers S1 and S2, which 

1 have been transmitted from the data transmission appa- 
ratus (transmitting end) 106, are not normally received 
at the data receiving apparatus?(receiving end) 206 due 
to a transmission error* in the data receiving apparatus 
•206, the error packet detection-unit 22 decides that 
: these highpriorit/pa^ets (S1) and (S2) are error pack- 
ets. Further, the reproduction' time decision Ciriit 43 
detects the reproduction times (T1) and (T2) and the 
'arrival times of these error packets, decides the arrival 
time limits (T1-kx) and (T2+ot) in accordance witii the 
reproduction times, and decides whether or not these 
: error packets "have arrived at the receiving end bafore 
the arrival time limits, respectively. 
[0187] Since the high priority packet (Si) has 
arrived at the receiving end before the time limit the 
transmitting end ' instructs the transmitting end to 
■retransmit this packet ' v "« f * 
[0188] - On, the other hand, since the high priority 
packet (S2) has not arrived at the receiving end before 
. .the time limit the receiving end does not instruct the 
:tiansmrtting end toTetransmit this packet. 
$[0189] c In^the data transmission apparatus 106, 
-when the data of the packet having the sequence 
: number indicated? by- the retransmission request' from 
the receiving, end, is -stored in the retransmission buffer, 
the data of the packet the transmission time of which 
does- not pass the reproduction time is retransmitted to 
the receiving end. On the other hand, as for the data of 
the packet the -transmission time of which has passed 
the reproduction time, this data is discarded without 
•being transmitted, and the data in the retransmission 
buffer is discarded successively from the packet which 
cannot arrive at the receiving end within the data repro- 
duction tima 

[0190] As described above, according to the sixth 
embodiment of the present invention, data transmission 
from the transmitting end to theTecerving end is contin- 
uously performed in units of packets each having addi- 
tional information relating, to its sequence number, 
priority, and data reproduction time at the receiving end 
and, simultaneously, data of the packets received at the 
receiving end are successively reproduced. At this time, 
only the packets which have arrived at the receiving end 
within the time limit at the receiving end, are retransmit- 
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ted to the transmitting end. Therefore, the transmissipn 
quality of wireless section in real-time transmission is . 
improved and, moreover, the number of retransmission 
times can be reduced. , \, 
[0191] * While in this sixth embodiment emphasis 
has been placed on the method for recovering errors of 
data in packets, there is a case where additional irrfor- . 
mation added to the packet header (i.e., the sequence 
number, the reproduction time, otc.) has an error, There 
are various methods- of recovering the additional infor- 
mation as well as recovering the errors in data. Herein- 
after, these methods will be described as modifications , 
of the sixth embodiment /- . v\ . c; \'2 

[Modification 1 of Embodiment 6] < - - ( .vrj. 

[0192] . In a first modification of the sixth embodi- 
ment, in addition to the processes at the transmitting 
end and the receiving end -in the data transmission 
method of the sixth embodiment : at the ; transmitting 
end, error, correction codes for the sequence number 
and the reproduction time are given to the packet to be 
transmitted. At the receiving end, error correction for the 
sequence number; and. the reproduction time iSf per- 
formed by utilizing the error correction codes and, there- 
after, error packet retransmission control} i& performed 
on the basis of the decided arrival limit time. , v - - 
[0193] In the first modification of the sixth embodi-. 
ment so constructed, even when the sequence number; 
and the reproduction time of the error packet have 
errors, these, additional information can be corrected. - 

[Modification 2 of Embodiment 6] H j - r ;. 

[01 94] : In a second modification of the ^ixth .embod- 
iment, in adcfition to the processes atr the transmitting 
end and the receiving end in the data transmission:, 
method of the sixth embodiment at the transmitting 
end, the sequence number and the reproduction time of 
a predetermined packet are embedded in a packet to be 
transmitted next. At the receiving end, the embedded 
information (i.e., the sequence number and the repro- 
duction time) of the previous packet (the predetermined 
packet) is extracted when the next packet is received: 
On the basis of this information, the arrival time limit of 
the predetermined packet is decided, and retransmis- 
sion control is performed for the predetermined packet 
as an error packet - 

[0195] : Figure 21 is a sequence diagram for explain- 
ing packet data retransmission control with time limit, in 
a data communication system according to the second . 
modification of the sixth embodiment. 
[0196] At the transmitting end, a predetermined 
packet is given the sequence number and the reproduc- 
tion time at the receiving end, and the sequence 
number and the reproduction time of this predetermined 
packet are also embedded in a next packet which is to ■ 
be transmitted next to the predetermined packet 
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[0197] Thereafter, as.shown in figure 21; 
(31) and k (S2).of sequence numbers SI and S2 are 
transmitted from the transmitting end,: and the: packet 
(S1) is not normally received at the receiving end due to 
a .transmission error. Even in this case, as long as the 
packet (S2) is normally received at the receiving end, 
the receiving -end can detect the sequence number S1 
- and the reproduction time (T1) of the packet (S1) previ- 
ous to the packet (S2). - n L : 
[01 98] So, at the receiving end, the arrival time limit 
(T1+a) is decided on the basis of the reproduction time 
(T1) of the- error packet (S1), and it is decided whether 
or not the receiving end can receive the retransmitted 
packet within the. arrival time limit if a. retransmission 
: request is made at this point of time. In this case, there 
is a possibility- that the packet (S1) will arrive at the 
receiving end before the time limit if a retransmission 
request for the packet (SI) is made when receiving the 
packet (S2) and, therefore, the receiving, end sends a 
retransmission request for the packet (S1) to the trans- 
mitting end. • . * ; . ? ■ ' ~ :r - 
[0199] Thereafter, as shown in figure 21, packets 
(S3) and (S4) of sequence numbers S3 and S4 are 
transmitted from the transmitting end, and the packet 
(S3) is not normally received at the receiving end due to 
a transmission error. Even in this case, as long as the 
packet (4) is normally received at the receiving end, the 
receiving end can detect the sequence number S3 and 
the reproduction time (T3) of the packet (S3) previous to 
:#ie packet (S4). 

[0200] So, at the receiving end, the arrival time limit 
(T3+a) is decidsd on the basis of the reproduction time 

\(T3) of the error packet (S3),: and it is decided whether 
the packet (S3) has arrived at the receiving end before 

. the time limit or not In 'this case, since 1 the packet (S3) 
has not arrived-at the receiving end before the time limit, 
the receiving end does not instruct the transmitting end : 
to retransmit the packet (S3). 

[0201] In the second modification of the sixth 
embodiment so constructed, at the transmitting end, the 
sequence number and the reproduction time of a prede- - 
termined packet are also embedded in a packet to be 
transmitted next to the predetermined packet. There- 
fore, even when errors occur in not only the data of the 
packet but also the sequence number and the reproduc- 
tion time, the receiving end can make a retransmission 
request for the error packet Moreover, since the receiv- 
ing end does not make a retransmission request for the 
packet which cannot arrive at the receiving end within 
the reproduction time at the receiving end, the number 
of retransmission times can be reduced. 
[0202] As still another modification, the selective 
retransmission control according to any of the first to 
fifth embodiments and their modifications may be com- 
bined with the time-limit retransmission control accord- 
ing to any of the sixth embodiment and its modifications. 
:[0203] For example, the second embodiment in 
which each packet is given error correction codes for its 
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sequence number and priority information may be com- 
bined with ihetf frstfmodif ication of the sixth embodiment * 
in which each packet » given' error correctton cedes'-for 
its sequence number and reproduction time (firsfeombi- ** 
nation). According to this combination, each packet is 5 ' 
given error correction codes for its sequence number, ^ ^-"x 
priority information, arrchreproduction time.. ~* ' ~-3. .:>: 
[0204] Further, the^ird en^bocfiment iri iwhidh^thiB ' * T " 
sequence number and the priority information of a pre- - * J : 
determined packet are embedded in a packet to be ; 
transmitted next ta>the predetermined packet; may~be 
combined "with the^second* modification of the~ sixth- 
embodiment in which the sequence -number and 4he^ 
reproduction time of : a predetermined - packet " are 1 
embedded irta packet to be transmitted nextta-thepre^ 
determined packet (second combination). Accortiing'tO 
this combination,, the tsequence number/ the priority : 
intonation, and the reproduction time of the predeter-A 
mined packet are embedded in the packet to be trdft&&- 
mitted next to the predetermined packet r* > :C} 
[0205] Further, the modification taf the third embod*^ 
imerrt in which the process of embedding the sequence 
number and the priority informations of a tiigh priority 
packet to be transmitted into subsequent packets^ jso 
continued until a next high priority packet ts transmitted, 
may be combined with the second modification of the- 
sixth embodiment in which the sequence number and 
the reproduction time of a? predetermined. packet afe< 
embedded in a packet.to be transmitted nextlathe pre- 
determined packet ^third combination). According to this . 
combination, the process of embedding the sequence 
number, the priority information, and the reproduction 
time of a high priority packet into subsequent :packets Is > 
continued untiha next high priority packet is transmitted.'^ 
[0206] Furthermore* according-to the. combination - 
of the selective retransmission control and-the retransf: • 
mission control with time limit (second or third^combina-;: 
tion), the quantity of data to be embedded in. the packet 
increases. Therefore, there is proposed a method at 
embedding a difference between the header informa- 
tion (sequence number, priority information, <reproduc- ; 
tion time) of a predetermined packet and the header : 
information of a subsequent packet, in, the subsequent 
packet - - ; : <r i 

[0207] ; Hereinafter, this method will be described as- 
a third modification of the sixth embodiment. " . 

[Modification 3 of Embodiment 6] * 



[0208] Figure 22 is a sequence diagram for explain- 
ing packet retransmission control with time, limit, in the 
data transmission method according to a third modifica- 
tion of the sixth embodiment 
[0209] At the transmitting end, Jn a packet to be 
transmitted next to a predetermined packet, difference 
information relating to .the sequence number and the 
reproduction time of the predetermined packet which 
has previously been transmitted is embedded together 



with the sequence number and the reproduction time of 
this packets Th& difference information is composed of 
a difference between the 'sequence number of the pre-" 
determined packet and the sequence number of the 
next packet (sequence difference) and a difference 
between the; reproduction time of the. predetermined 
•packet and the- reproduction time of the next .packet 
(time difference).- v. . . -■. : . ...... 

[021 0] For exampfe, as shown in figure 22,' packets 
^S1) and r (S2yof sequence numbers S1 and : S2 are 
'. : .1 transmitted- from the transmitting end, and the packet 
U - r (51) is not normally received at the receiving end due to' 
transmission "error; Even in this case, as long as 'the 
packet (S2) is normally received at the receiving" end, 
is' the receiving end can obtain the sequence number S1 
* -rand the reproduction time (T1) of the packet (S1) previ- 
. ous to the packet (S2). 

~ [0211] That is; the sequence number S1 of <the 
. ; packet (S1 ) can ^be ^obtained - by isobtracting ■ the 
2ff /^sequence difference (S2-S1) from 1 the sequence 
* *\\ number S? of the packet (S2).:Fufther, the reproduction 
r time (T1) of the 1 packet (S1) can be obtained by sub- 
? tracting the difference time (T2-T1) from the reproduc- 
? \t fion time (T2y of me packet XS2). - ^ - ; 

s& [0212] ifFherefore, atthe receiving*' end/ the arrival 
^time1imit-(T1-f a) is decided on the basts oTthe repro-r 
3 reduction time (T1)-of the error packet (S1); and tt is 
:-' \ : decided whether this packet has arrived at the receiving 
' end before the. arrival time limit or not. For example, 
when the^ packet (St)- has arrived at the receiving end 
; - before the arrival time limit, the receiving end instructs 
..the transmitting end to retransmit the packet (ST), by 
fusing the sequence number S1. - 
[0213] In the third modification of the sixth embodi- 
ment so constructed, since a difference between the 
^header information (sequence number, priority' informa- 
:;tron ( reproduction time) v ofra predetermined packet and 
the header dnformation of a 'subsequence packet is 
r. embedded tn the subsequence packet the quantity of 
. information to be embedded in the packet is reduced. - 
[0214] -While in the third modification of the sixth 
, embodiment the sequence number and the' reproduc- 
- tion time are described as information to be embedded 
in the subsequent packet information to be embedded 
is not restricted thereto. For example, in addition to the 
sequence number and > the reproduction time, the 
retransmission count and the priority may be embed- 
ded. • ::.*■< 
[0215] Hereinafter, a description will be given of 
•embodiments relating to application sections of the 
retransmission control of the data transmission meth- 
ods according to the aforementioned embodiments. 
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[Embodiment 7] . >■ 

[0216] In a data transmission method according to 
a seventh embodiment of the invention, data transmis- 
sion between a distribution server and a terminal is per- 



21 



, 8NSOOCJD: <EP_^1006689A2JlJ»' 



41 EP1 006 689 A2 42 

formed in packet units through a relay server and, at the betweerrthe distribution server and the relay server ^ 

terminal end, data of received packets are successively • be reduced. '/ " :t r ' - v * *' vr 

reproduced. When a transmission error occurs between / " ? - '■ ' : * * : 

the relay server. and the terminal, the relay server per- * [Modificafen of Emt^iment 7] ^ 

forms retransmission of the error. packet in accordance '■ $ ■ : .- - : • - ^ 

with a retransmission request frbm the terminal. When a ~ [0224] - A nioclificatitrfi of the seventh embodiment is 

transmission error occurs between the distribution » * a data transmission method in which data transmission 

server and the relay server; the distribution server per- • between a distribution server and a terminal is per- : 

forms retransmission of the error packet ^accordance *■ : formed inf packet units through a relay server and, at the 

with a retransmission request which is transmitted from g terminal end, data of received packets are successively 

the terminal through the relay server. ^ r-. : reproduced. When a transmission error occdre b^eeri 

[021 7] ' ■ Figure 23 is a block diagram for explaining a the distribution server arid the relay server, the error 

data transmission method' according to this seventh packet is not transmitted to the terminal, but the relay ' 

embodiment, illustrating a data transmission apparatus server transmits a retransmission request to the distri- 

107 in a system performing data transmission according is ~- bution server and the error packet is retransmitted from 

to the data transmission method. ^ * the distribution server to the relay server. 

[0218] This datai transmission apparatus 107 con- - [0225] Rgure 24 is a block diagram illustrating a 

stitutes a relay server {transmitting end) which relays ; data transmission apparatus 107a in a data communi- 

data transmitted between the distribution server and the : cation system according to the modification of the sev- 

terminal (receiving end), and it includes- a retransmis- 20 ertth embodiment 

sion instruction oufcut unit 51, in addition to the cohstit- [0226] The data transmission apparatus 107a con- 

uentsof the data transmission apparatus 101 of the first" stitutes a relay server (transmitting end) which relays 

embodiment. The retransmission instruction output unit ' ' ■ data transmitted between a distribution server and a ter- 

51 instructs the distribution server to retransmit an error minal (receiving end), arid it includes an error packet 

packet forwhi(^ a retransmission request has been out- '25 -decision 'unit 22, a reception history management unit 

put from the terminal, on the basis of the result of deci- 52, and a retransmission instruction output unit 51a, ih 

sion in the retransmission propriety decision uhrt 16. addition to the constituents of the data transmission 

Other constituents of the data transmission apparatus apparatus 1 0 1 of the first embodiment The error packet 

1 07 are identical to those of the data transmission appa- decision unit 22 decides whether each packet received 

ratus 101 of the first embodiment - :f 30 is an error packet or not on the basis of the output frbm 

[0219] rt Next; * the function and effect wilf be the receiving unit 11 which receives packets from the 

described. r ; ' d^ 

[0220] In the seventh embodiment so constructed; ■ ets. The'tefceptibn history management" unit 52 man- 
when data trahsmissidn between the distribution server ages the history of the normally received packets. The 
and the termiriar ©'performed in packet units, the data :y & ^retransmission instruction output : unit 51a instaictstfe 
transmission apparatus 107? relays data -between /the ^ /distributidn server to Tetransnriit ;the error pocket, 
distribution' server and trie terminal: 1 ■ u ' 1 according to th^ 

[0221] When a transmission error occurs between : sion decfsibn unit 16; the result of the detection in tii& 

the relay server (data transmission apparatus 107) and ~ error packet detection unit 22, and the contents of the 

the terminal, the relay server performs retransmission of ko reception history in the reception history management 

the error packet. In this case, a retransmission request unit 52. Other constituents of the data transmission, 

for the error packet frbm the terminal is not relayed to apparatus 107a are identical to those of the data trans- 

the distribution server. . mission apparatus 101 of the fi^ 

[0222] - Further, when a transmission error occurs - ; [0227] - Next, the function and effect will be 

between the distribution server and the relay server 4s described: ' ' * * 

(data transmission apparatus 107), a retransmission [0228] ' In the modification i of the seventh embpdi- 

request for the error packet from the terminal is trans- ment so constructed, 1 when data transmission between 

mitted to the distribution serverf and the error packet ' the distribution server and the terminal is performed in 

which is retransmitted from the distribution server is 3 packet unite, the : data transmission apparatus 107a 

relayed by the data transmission apparatus 107 to be so relays the data between the distribution server and the 

transmitted to the terminal. terminal. 

[0223] In the seventh embodiment so constructed, [0229] When a transmission error occurs between 

when a transmission error occurs between the relay the relay server (data transmission apparatus 107a) 

server (the data transmission apparatus) and the termi- ' and the terminal, the relay server performs retransmis- 

nal, a retransmission request for the error packet from 55. sion of the error packet In this case, a retransmission 

the terminal is not relayed to the distribution server, and ^ request for the error packet, from the terminal is hot 

the relay server performs retransmission of the error ~ relayed to the distribution server. ' ' J ' 

packet Therefore, the number of retransmission times [0230] Further, when a transmission error occurs 



22 



43 EP 1 006 689 A2 44 

between the distribution server and the relay server through the transmission unit 13. The allowable repro- 
(data traremiraon apparatus 107a) f the error packet is- duction delay inforrration receiving unit 72 receives 
not transmitted to the terminal, but a retransmission : . , information relating to the allowable reproduction delay 
request from the relay server is transmitted to the distri- time (arrival time limit) from the receiving end (terminal), 
bution server and the error packet is retransmitted frqrjj.... 5., .[0238] Further, the data transmission apparatus 
the distribution server to the relay server." ' " 1 08 includes a transmission delay measurement packet 

[0231] . Then, the relay server transmits the- error . ^ transmitting-and receiving unit 71;. and a transmission 
packet retransmitted from the distribution server, to -the, \ ; delay measurement oinrt 73. The transmission delay • 
teirrrinal., . ~ . * ^ ?„. - - . ^ - r .-^measurement packet transmitting and receiving unit 71 

[0232] . i Tn. the modification of the seventh enrdjpdU; ,10 V t performs transmission and reception of a packet used ' 
ment, when a transmission error occurs between the , ; for measuring ^ transmission delay<.(transmission delay 
distribution. server and the relay server, the error packet t i . _ measurement packet). The -transmission delay meas- 
is not transmitted to the terminal, but the. relay serve/ :r urement t unit.73 measures , a s transmission delay in 
outputs a retransmission /request to the. distribution,. . atx»rdance wrththeitime required for forward and back- 
server and, thereby the distribution server retransrrtit§ r is .ward transmission of the transmission delay measure- 
the error packet to the relay server. Therefore, wasteful . , men*, packet between the transmitting- end and the 
transmission of the erroj: packet from .the relay server to . , receiving end. 

the terminal is avoided. , i: v . r ;\ [0239] Further, the data transmission apparatus 

• - ( . , 7 . , . , :u 108 includes a..reproduction time- calculation unit,- 74 
[Embodiments] . . _ v . % , 2p. v which estimates. the data -reproduction time at the 

^.y— ./,^r/Bceiving end, in accordance with the transmission . 
[0233] . Figures 25-27 are diagrams for explaining a delay, the time stamp, and the allowable reproduction . 
data transmission method according to an .eighth . . delay time (arrival time limit), r and outputs the estimated^ - 

embodiment of the present invention. . , { . reproduction time ; - : . . r - 

[0234] In this data transmission method, datatrare-, . 25 . [0240] Furthermore, like the data transmission ^ 
mission between a distribution server and.a terminal, is ' apparatus according 4o embodiment 1 or 6, the data ? 1 ' 
performed in packet units, and, at the terminal end, data - ,' -transmission apparatus 1 08 has the function of storing a ^ . * 
of received packets are successively reproduced.. Fur- I packet tho priority of -which is equal to or higher than a J \ 
ther, information about a reproduction delay time which . predetermined value in a retransmission buffer and dis* 
is allowable for the. data reproduction time at the termi- do .carding a packet which cannot be in the time for retrans- 
nal end,, is transmitted from the terminal to the distribu- . , mission, and the function of retransmitting a packet for c j ■ 
tion server. In the distribution server, the reproduction . . which a ^ retransmission Request is output from the 
time at the terminal is estimated on the basis of the / . receiving end, although these functions are not shown ''y 
reproduction .delay time and the transmission delay.timjB ^ 7 . in the figure. t , v ., , ... v ^- * ^ 
which is required. for data transmission between the di^-j '.35 .[0241] . To be specific, the (data transmission appara- 
tributionseiverai^ ( theierj^nal". J ,.*. . J ' ; . " f;tus 108 includes the qonstityents corresponding to the 
[0235] \ Figure t 25„is a block diagram .illustrating ^a ,^ ..retransmission instruction receiving unit 14, the packet 
data transmission apparatus 108 in a data i Communica^ decision unit 15, the retransmission decision 

tion system according to this eighth embodiment of the _\ "1. unit 16, the, retransmission buffer 17, and the retrans- 
invention. , t . . \ ( , J/ 40 mission buffer managemem unit 18 whiqh are inciuded 

[0236] _ This data transmission apparatus 108 con- \ " in the data transmission apparatus 101 of the first 
stitutes 9 relay server (transmitting end) which relays V.. embodiment In the transmission queue management 
data transmission between a distribution server and a , unit 12, setting of the packet transmission order is per- 
terminal (receiving end), and it includes a receiving unit . * \' formed on all the packets to be transmitted, including 
1 1 , a transmission queue management unit 12, and a 45 - not only the received packets but also the packets to be 
transmission unit 13. The receiving unit 11 receives transmitted^ ... r 

packets transmitted from the distribution server. The [0242] Figure 26 is a block diagram illustrating a 
transmission queue management unit 12 seis the trans- /. data receiving apparatus 208 in the data , transmission 
mission order of the received packets, in accordance . . system which performs real-time. data transmission by. 
with additional information, such as a . sequence so, the data transmission method according to this eighth ~ 
number, which is given to each packet The.transmis- : . "* embodiment 

sion unit 13 transmits the packets in the transmission [0243] The data receiving apparatus 208 includes a 
order which is set by the unit 12. receiving unit 21 which receives packets transmitted 

[0237] The data transmission apparatus 108 further from the relay server (data transmission apparatus at 
includes a time stamp extraction unit 75 and an allowa- ss . the transmitting end), and a packet decoding unit 23 
ble reproduction delay information receiving unit 72. which decodes the received packets. 
The time stamp extraction unit 75 extracts a time stamp . a [0244] The data receiving apparatus 208 further 
which is given to each packet as time information, includes a transmission delay measurement packet 



BNSOOCtD: <£P_ 7 _1006689A2J_> 



23 



45 



EP 1 006 689 A2 



46 



transmitting .and receiving unit 62, an. allowable jrepro- : - receiving unit 62 at the receiving end to the ^nsrnitting 
duction delay decision unit 63, and an allowable repror t and receiving unit 72 at : the transmitting er^, 'whereby 
duction delay information transmitting unit . 61. The . the server-to-terminal transmission delay da is obtained 
transmission delay measurement packet . transmitting by the transmission delay.measurement unit ; 73 and out- 
and receiving unit .62 recayes the transmission delay s puttotherepi^uc^ontimeca^ 
measurement packet Which has been transmitted from v when each packet is.output from the servenis measured 
the transmission delay measurement packet transmit- *. at the transniitting end. V,. . * y ...... 

ting and receiving unit 71 at the transmitting end. and {0250] ..^Then. the production time calculation unit 
returns it to the transmitting end. The allowable repro-, , 74 estimates the reproduction time (packet output time) 
duction delay decision unit 63 decides an allowable 10 to of each packet at the receiving W 
reproduction, delay time, and outputs inforrotioajeiajK • ~ [0251] - To be specific, as shown in figure 27(a), the 
ing to this. The allowable reproductiOT delay it^r^nation - packet output time to is obtained by adding the allowable 
transmitting upit 61 transmits the information relating to - ^reproduction delay time cL to the time stamp U and the 
the allowable reproduction delay time, to the transmit- terminal . reception tirne t, is obtained by adding the 
tingend.^ ... . ; r 1$i 3erver-tchterminal> transmission delay dg to the server 

[0245] Furthermore, lite the data receiving appara- output time V : Accordingly, the reproduction time calcu- 
tuses according v to embpdiments 1 and 6, the data- ?-y lation unit 74 obtains the packet output time to by (tp + 
receiving: apparatus 208^as the^function^xrf detecting: . .dp) and the germinal re^iOT 
error packets and outputtinga retrjansmission request -j. ; : [0252] .^Thereafter, in the data transmission appara- 
for an error packet which, can, be in the time for retrans- 20. tus 108, on the basis of comparison between (tg + dj 
mission, althpugMhis is not shown in tine figure. ' : \* and (tp + dp), rtjs decided whether the transmission 

[0246] t . : To be specif ic, s the data receiving apparatus , packet can arrive at the receiving end before the repro- 
208 includes the constituents corresponding to the error ..duction time or not. i.e., whether the relationship, termi- 
packet detection, unit 22, the reception history manage- , ^ nal reception time tr s packet output time t» is satisfied 
ment unit 24, the packet priority decision unit 25, and_ 25 -or not. Based on the result of this decision, retransrrtis- 
the retransmission instruction output f unit 26 which are : s sion of the error packet requested, and discard of the 
included in the date receiving apparatus 201 of the first ,, r ? packet in the retransmission buffer are performed, 
embodiment . - v v . [0253] * While in this eighth embodiment the repro- 

[0247] Next, the fonction and > effect will be , duction delay d p is transmitted from the receiving termi- 
described. , , , so -rial to the. server, this may be a fixed value. Further, 

[0248] ; , Figures 27(a) and 27(b) are, diagrams for «, temporal, synchronization befeveen the server and the 
explaining a method for estimating the data reproduc- , terminal is made by, for example, NTP (network time 
tion time at the terminal, in the server according to this (J ~ protocol) pfrlnternet standard. r 
eighth embodiment More specifically,: figure ? 27(a) ^ ri ^[p254] further, the time stamp tp of each packet is 
shows the relationship between the packet time stamp , .v35 c obtained .from the time stamp of the. FTP header, this 
and the packet output time (reproduction time) or the ■• -time stamp yalue.rnust be mapped onto the same time 
lite, are! figure 27(b) shows a method for mapping the - : axis .v 
time stamp to the, standard tima -.;. ; , v v . L ( [0255] Hereinafter,, the RTP time stamp mapping 

[0249] \n the .data transmission apparatus . (trans- . method in ^e relay server will be described brief ly. 
mitting end) 108, when the transmission unit 13 per- [0256] Since the RTP time s tamp is not expressed 
forms packet transmission in accordance with the , directly by the standard time, it is mapped to time infor- 
transmission order .which is set by the transmission: v * ration based on the standard time, by using informa- 
queue management unit 12, the time stamp tp included ^ tion included in other standard protocols RTCP (Real- 
in each packet is extracted by the time stamp extraction *. . , Time Control Protocol) and RTSP (Real-Time Stream 
unit 75, and output to the reproduction, time calculation 45 Protocol),- The relay server (data transmission appara- 
unit 74. further, the allowable reproduction delay time. tus ) 108, must know this mapping information and, 
dp which is decided by the decision unit 63 of the data . therefore, the relay server 108 obtains this mapping: 
receiving apparatus (receiving end) 208and transmitted : information when it relays the mapping information, 
through the transmission unit 61, is received by the [0257] . For example, as shown in figure 27(b), when 
allowable reproduction delay information receiving unit so the mapping information for the time stamps included in 
72 and output to. the reproduction time calculation unit. . the Internet standard protocols RTCP and RTSP, which 
74. Further, the transmission delay measurement is output from the server S. is relayed by the relay server 
packet is transmitted from the transmission delay meas- . . iS to the terminal T, the mapping information is analyzed 
urement packet transmitting and receiving unit 71 at the by the relay server IS. Further, the mapping information 
transmitting, end to the transmission delay measure- ss for the time stamps at the terminal is transmitted from 
ment packet transmitting and receiving unit 62 at the - the terminal to the server. - ./; 

receiving end, and the transmission delay measure-. [0258] As described above, according to the eighth 
ment packet is returned from the transmitting and embodiment since the server (data transmission appa- 
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ratus) estimates the actual output time (reproduction 
time) of eacKpadket atthetenninai; a packet wWch can- 
not be in tirn^ for u reprbciuct:cn can be elirninated trditi 
the retrarsmissfoh bijffer> - >v 
[0259] ' In this eighth embodiment, the method 'for 
deciding the transmission delay lime and the allowed <? 
reproduction delay tiniels not restricted to the.above 1 - 
mentioned method. For example, during data reproduc- 
tion at the receiving end, : the transmission' delay 
between the server 'arid the terminal may be dynami- 
cally updated according to the information" from the 
receiving end, Alternatively, during data reproduction at 
the receiving end.'the allowable reproduction delay may- 
be measured and changed dynamically. 1 * - 
[0260] Furthermore, white" in this eighth emtxxji- 
ment the actual output time (reproduction time) of each- 
packet at the terminal is- estimated in* the relay server ! 
(data transmission apparatus), it may^be estimated in 
the distribution server in. accordance with the allowable 
reproduction delay time from the terminal or the trans- 
mission delay time' required for data transmission ' 
between the distrtoution server and the terminal; - ~ 

[Embodiments] 

[0261] - Rgures 29-31 are diagrams for "explaining a 
data transmission method according to a ninth embodi- 
ment of the present invention. In the dataTransmission' 
method of this ninth embodiment data transmission 
from the transmitting end to the* receiving end'is contirv 
uously performed in units of packets each having" addi- 1 
tional information relating* to its sequence number, 
priority, and data reproduction time at-1he receiwng- end, 
which are required to realize real-time trahsmissibn- in 
packet units, while successively reproducing data bfthe 
packets received at the receiving end. At this time; tfilly 
error packets the: priorities Of which^are' equal to <>r 
higher than a predetermined value are retfansmitted.'* 
[0262] r : Figure 29(a) is a block diagramMllustrating a 
data transmission apparatus 109 in a data transmission 
system which performs real-time data transmission 
according to the data transmission method of this ninth 
embodiment.' v- ■* ■•* *?r - - • .? . ?* » 
[0263] The data transmission apparatus 1 09 Consti- 
tutes a relay server (transmitting end) which^elays data 
transmitted between a distribution server and a termi nal 
(receiving end). The data transmission apparatus 109 
includes a receiving unit 1 1 , a transmission queue man- 
agement unit . 12, and a transmission unit 13. The 
receiving unit 1 1 receives packets' transmitted from the 
distribution server. The transmission queue; manage- 
ment unit 12 sets the transmission order of the received 
packets and the packets to be retransmitted (retrans- 
mission packets) in accordance with the above- 
described additional information. The transmission unit 
13 transmits the packet data in the transmission order 
which has been set by the transmission queue manage- 
ment unit 12.. 
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[0264] The data transmission apparatus 1 09 further 
• ; includes a high priolrity sequence number management 
" unit 81, a sequence^number correspondence manage- 
* merit unit 82, and a high priority sequence number 
1 insertion unit 83. When the priority of a packet transmit- 
ted by the transmission unit 13 is equal io or higher than 
a predetermined value, the high priority sequence 
number management unit 81 increments the value of 
*4he sequence number which corresponds to only the 
high priority ^packet (high priority sequence number); 
and- stores the'" incremented value. The sequence 
number correspondence management unit 82 stores 
^ the correspondence between the value of the sequence ' 
number of the transmitted high priority packet and the 
■ value of the incremented high priority sequence number 
c of this high priority packet. The high priority sequence 
number insertion?: unit 83 outputs the value~of the high 
priority sequence number of each high priority packet, ' 
, which is stored in the management unit 81, so that it is 
inserted imthe-packofto be transmitted. • ~ ^ 

[0265] The high priority sequence "numbers man- 1 
aged by the high priority "sequence-number manage- 
ment unit 81 correspond to the number of higrvpriority 
packets transmitted from the transmitting end? ^ ; : 
[0266] Further, the data transmission apparatus 
1 09 includes a retransmission buffer 1 7, a packet prior- 
ity decision unit 15, and a retransmission buffer fhan- 
agement uniM8>The retransmission buffer* 17 stores 
predetermined packets amongst the received packets, 
as retransmission packets. The packet priority decision 
unit 15 decides the priorities of the received packets. 
r The retransmission rxrffer management unit 18 controls 
the retransmission buffer 17 -such that data of packets 
the priorities of which are equal tar or higher than* a pre- 
determined value ate stored in the buffer 17, in accord- 
ance witft the de^ - 
1 [0267] Further, the data transmission apparatus 
'109 inciudes a retransmission instruction receiving unit 
- Y4 and a retransmission decision unit 16c. The retrans- ' 
mission instruction receiving unit 14 receives a retrans- 
mission request indicating a high priority sequence" 
number, from the terminal at the receiving end. The 
retransmission decision unit 16c decides - whether 
retransmission of a packet for which the retransmission 
request has-been made is performed or not. The b 
retransmission decision unit 18 retrieves the manage- 
ment information in the sequence number correspond- 
ence management unit 82, in accordance with the high 
priority sequence number indicated by the retransmis- 
sion request to obtain the sequence number corre- 
sponding to the high priority sequence number used for ' 
the retransmission request, and decides that the 
requested packet is to be retransmitted, only when the 
packet of the sequence number is stored in the retrans- 
mission buffer 17. ; 

[0268] In figure 29(a), real-time data transmission is 
performed in packet units between the distribution 
server and the terminal through the relay server or the 
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like, and the data transi^ssion .appai^ 1Q?consti-- - [0273] The higkpriorfrseque 
tutes the ; relay server. However, the relsry server may v ,raent unit 91 increments the value of the storsd jeceiv- 
serve as the distribution server. To be specific, when the , ing end high priority sequence number every time the- 
data transmission apparatus serves as the distribution - v ■ retransmission sequence number decision unit 92 out- 
server, it is.constructed as shown in : figure 29(b). In fig- . 5., & puts a high pripr^s^uenca.number. j~ * £T . " . 
ure29(b)„the receiving unit 11 I of the date transmission [Q274] /.-Further! the date receiving unit 209 includes 
apparatus 109 .is.replaced.with a coded packet genera- a: retransmission instruction output unit 26c which out- 
tion unit 10a which encodes the data and qutputsthe c - puts a retransmission requester an error packet to the 
coded data-in packet. units. : and a priority. allpcation : unit - ^transmitting, end, on ithe.basis of the transmitting end 
10b which allocates additional information, such as a 10 high priority, sequence , number which is output as a 
priority, to each jacket output from the axled packet - retransmission sequence number from the retransmis- 
generation unit 10a. , _ >sion seq uence number decision unit 92. \ - 

[0269] Figure 30 isi a block diagram .illustrating a ., [0275] ;Naxt, .the .function and effectvwill be 
data receiving apparatus 209 in the data transmission ;;, described: - • ■ n / r- 

system which performs real-time data transmission J§ y[G276] r-^Rigure31-is a sequence diagram for explain- 
according to the data transmission method ofr the Ointh - ing the selective packet retransmission control in; the 
embodiment. < • ; „ - r -.- v y ; ; : . ? * , * - - . i -data transmission method of this ninth embodiment. 
[0270] "me data receiving^ ; ; [0277] .^ln the description with respect to figure.31, a 

receiving unit 21 , -an error packet.detection unit,.22a, v sequence number-fS+n] indicates^ sequence number 
and a packet decoding unit 23 v The receiving unit 2%: 20 having a value "S-wT, a sequence number [H+n] indi- 
recerves the packets transmitted froiri; the data tr^nsv cates a high-priority^sequence number having a value 
mission apparatus at Jhe transmrtdng : «Td^ The error * !H+n", and a packet (S+n) indicates a packet having a 
packet detection unit 22a detests error packetein which, ~ r sequence number the value of which is "S+n". Further, 
errors have occurred during transmission, and outputs ;rcisany otf O, 1;2, 3, 4. and 5. 

normal packets which have been : transmrttecLwithout 25 ^ [0278] For example, - s assuming that the priorities 
transmission errors.. The packet decoding unit 23. equal to or higher than the predetermined value are 
receives the v normal packets and decodes the coded > - high priorities while the priorities lower than the prede^ 
data of the normal packets, y - . . : y ^ - - termined value are low priorities, as shown in figure 31, 
[0271 ] When the high priority sequence number - - when an error has occurred during transmission of high 
inserted in the packet from the datatransmission appa- 3qc rpriority packets (S+1) and (S+2) of sequence numbers 
ratus (transmitting end high priority sequence number) . „ Q [S+1 ] and i[S+2], retransmission requests for-these high 
is correctly extracted, the error packet detection unit 22a : u : priority packets are made at the receiving end. How- , 
outputs both of the value of the transmitting , end high r viewer, when an error has occurred during transmission of 
priority sequence number and the value of the receiving : c f a~low priority jacket (S*3) of sequence number [S+3], 
end high priority sequence number at ^is point of tima-.; .3^ ; -no retransmissionirequest is made forcttiislow priority 
The value of the receiving end high priority number cor- rs ■; packet (S+3). ~ ; . * , . 

responds to the number of ^the high priority -packets ; :" .[0279] : ;To be specif ic ( each packet transmitted from 
received at the receiving end, and this value is incre- < *• ; i.the distribution server is given additionai' information : 
mented every time: a high. priority packet is received at ■ - relating taits sequence. number and priority. In the data 
the receiving end. . ^ , - 40 transmission apparatus 109 as a relay server, thetrans- 

[0272] Further,^ the -data- receiving apparatus~209 * " . -.mission order of the received packets is set by the trans-- 
includes a high priority sequence number management - = emission queue management unit 12, and -then the 
unit 91 and a retransmission sequence number decision packets are supplied to the. transmission unit 1 3. On the 
unit 92. When the error. packet detection unit 22a out- t . other hand, the. priorities of the^received packets are 
puts a normal packet, the high priority sequence -.: 45 . decided by the packet priority decision unit 15. Then, in 
number management unit 91 increments the value ot the transmission unit 13, transmission of these packets 
the receiving end high priority sequence, number and is.performed according to the transmission order which: 
stores it. The retransmission sequence number deck has been set Further, those packets the priorities of 
sion unit 92 compares the.value of the transmitting end ... which are decided as being equal to or higher than the 
high priority sequence number output- from the error so predetermined value are stored in the retransmission 
packet detection unit 22a with the value of the receiving buffer 17 under control of the retransmission buffer 
end high priority sequence number. When these values management unit 17. Further, in the retransmission 
are not equal, the decision unit 92 outputs the values ; buffer 17, data are successively released (discarded) 
ranging from the value obtained by adding 1 to the value.. * . ;from the packets which cannot be in tine for reproduc- 
of the receiving end high priority sequence number to ss tion, under control of the management unit 18. ! - 1 
the value of the transmitting end high priority sequence - ; [0280] Next, a description will be given of manage- 
number, as the values of retransmission sequence num- _ - ment of the sequence numbers at the time of packet 
bers (transmitting end high priority sequence numbers). transmission. 
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[0281 ] When transmitting a high priority packet the number insertion unit 83. Likewise, when the low priority 
high priority sequence number is incremented.' ;* " packet (S45J ! is%Bnsmitted. the value of ^ 

[0282] 7o r be%pecific, when a higrt-priority * packet r ^end high'^riorrt^sequence number [H+3] which is 
(S+0) of sequence number [S+0] is fransmitted by "the ^stored in the high priority sequence number manage- 
transmission unit 13, the value of the 4rarismrttinfl -end - s 1 * - ment unit i 81 at this point -of time, is embedded in the 
high priority sequence number fH+0] which rs v stored W ir: k ? header of the transmission packet (S+3) by the high pri- 
the high priority sequence number management i!nif81 ^ verity sequence number insertiorfunit 83. Thereafter, the 
is incremented to *H+r; At thistime; the* value of the : - transmission packet having the transmitting end high 
sequence number.[S+0] of the high priority packet (S+0)s * ^.priority sequence number so embedded in its header, is 
and the incremented value of the transmitting efta high ^' W.. transmitted to the receiving-end by the transmission unit 
priority sequence number [H+1] are ertered, by one^to- :*3. * •* r> ' 1 '- '■- r: - : '. :r 

one correspondence, in the sequence -number corre- ^ v* [0289] " Those packets output from the distribution 
sporcience management unit 82: - * = : .v server are successively transmitted to the terminal '(data 

[0283] .Likewise, when:aitigh;priority packet (S+1) teceMng^aratifcy^O^rbugh the relay served 
of sequence number [S+1] is transmitted by the trans- "rs-^ [0290] ' In- the datef receiving apparatus 209, the 
mission unit 13, the value J otehe transmitting endJfigh "jackets fromr the retey Server^data transmission appa- 
priority sequence number {H+1] which is stored- Irtihg? ^ meatus) 109 are received by the fedefvihg unit 21 , arid the 
high priority sequence number ^management unit<8Tfe * received packets are supplied to the error packet detec- 
incremented to ."H+2". At; this time, the value ^f ' the T ~ tion unit 22a. The normally received high priority-packet 
sequence number [S+1] ofthe high priority packet(S+1) ^5© : (S+0) is ouftfutfrom the error packet detection unit 22a 
and the incremented value of the transmitting -end High:- 0 to the- packet decoding ^unit 23, arid the'valiie of its 
priority sequence number [H+2] are entered;. by-one=KK .* ^-receiving ehd^high-prioritSr sequence dumber (i.e., the 
one correspondence, in the sequence number corre^ : , rvalue ofthe high priority sequence number [H+0] stored 
spondence management unit 82. x - , i .. in the high.prioritys^uence number management unit 

[0284] Further, also when a high priority- packet 25 ?91) is incremented to "H+1 \ 

(S+2) is transmitted, like the, high priority packets (S+0) / [0291] It is assumed that a traremission^error has 
and (S+1), the transmitting end high priority sequence - occurred durirtg transmission of the high priority packets 
number [H+2] in the high priority sequence numbers 4S+1) and (S+2) :aihd, thereafter, the low priority packet 
management unit 81 is incremented, and the sequence r. - - 1S+3) subsequent to these packets has been transmit- 
number [S+2] of the high priority.packet (S+2):and:the ; .w v ted without a transmission error, 
incremented transmitting end high priority sequence - 1. ~ [0292] An this sase, the normally transmitted low pri- 
number [H+3] are entered, by one-to-one correspond-./ t ority packet (S+3) is-output from the error packet detec- 
ence, in the sequence number correspondence man-c . tion unit 22a loathe packet decoding unit 23, but the 
agementunit82. v'.-..to .vj"" lvalue of the receiving end-high priority sequence 

[0285] On the;other hand, when transmitting a *ow * 35^ i number [H+1] which is^ stored in the high priority 
priority packet the corresponding low priori^sequence^f^. ^. sequence^iTumber management unit 91^is net incro- 
number is not incremented. '.r^l-) :t : merited. - r - c j <.tr u 

[0286] ■ To be specific, ■ when a low priority packet t [Q293] < Further, in the error packet detection unit 
(S+3) of sequence number [S+3] is transmitted by the 22a, when the transmitting end high priority sequence 
transmission unit .13;, the value of the transmitting end; 140 -numbers [H+0] and [H+3] which are iriserted-tn the high 
high priority sequence number [H+3] stored in the.high ; priority packet (S+0) and the low priority packet (S+3), 
priority sequence number management unit 81 is^ not . respectively; are correctly extracts, these transmitting 
updated but maintained as it is. At this time, the process r. >■ end high priority sequence numbers [H+0] and [H+3] 
of entering the sequence number of the transmitted 1 > are output to the retransmission sequence number deci- 
packet and the transmitting end high priority sequence 45 . sion unit 92. Further, the receiving end high priority 
number [H+3] which is stored in the high priority sequence numbers [H+0] and [H+1] which are stored in 
sequence number management unit 81, in the" the high priority sequence number management unit 91 
sequence number correspondence management unit at the time when the transmitting" end high priority 
82, is not performed. . .. . a sequence numbers [H+0] and [H+3] are extracted by 

[0287] Next, a description will be given of a so: the error packet detection unit 22a, are output to the 
sequence number embedding process at the time of • • ^retransmission sequence number decision unit 92. 
packet transmission. [0294] For example, at the true when the transmit- 

[0288] When the high priority packet (S+1) is trans- ting end high priority sequence number [H+0] is 
mrtted, the value of the transmitting end high priority extracted,, the value [H+0] of the receiving end high pri- 
sequence. number [H+1] which is stored in the high pri- ss ority sequence number stored in the high priority 
ority sequence number management unit 81 at this sequence number management unit 91 as well as the 
point of time, is embedded in the header of the trans- transmitting end high priority sequence number [H+0] 
mission packet (S+1) by the high priority sequence are output to the retransmission sequence number ded- 
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sion unit 92. At the time when the transmitting end high 
priority sequence number [H+3] is extracted, the value 
[H+1] of the, receiving end high priority sequence 
number stored in the- high priority sequence,, number 
management unit 91 as well as the transmitting end- 
high priority. sequence number [H+3] are, output to the 
retransmission sequence number decision unit 92. \ . 
[0295] ; . ln the ^retransmission sequence number 
decision unit 92, the transmitting end high priority 
sequence number and the receiving end high priority . 
sequence number, which have been supplied at the 
same time, are compared, to decide whether retrans- 
mission is to be requested to the transmittmg end^ -■ 
[0296] For example, as the result of the comparison : 
between the transmitting end high priority sequence 
number [H+0] and the receiving end high priority 
sequence number [H+0] ( since the values of these high ? 
priority sequence numbers .are equal, no transmission : > 
instruction is performed. On the other hand,* as the 
result of the comparison between the transmitting end r 
high priority sequence number [H+3] and the receiving, 
end high priority sequence number [H+1], since the val- - 
ues of these high priority sequence numbers are not 
equal, a retransmission instruction is performed. Jn this 
case, the- values ranging from the rvalue obtained by 
adding 1 to the, value of the. receding end. high priority . 
sequence number [H+1] to the value of the transmitting - 
end high priority sequence number. [H+3], i.e., "H+2" 
and "H+3", are output to the retransmission instruction - 
output unit 26 as the values of- the high priority 
sequence numbers used for , the retransmission instruc- 
tion. At this time, in the high priority sequence number * 
management unit 91, the value of the stored receiving . 
end high priority sequence number is incremented twice 
to be "H+3 V *. — - - ; > ;. ■= 

[0297] 0n receipt of "H+2" and. "H+3" as the values = 
of the high priority sequence numbers, the retransmis- . 
sion instruction output unit 26 outputs a retransmission 
request with the high priorrty^sequence number [H+2] 
and a retransmission request with the high, priority 
sequence number [H+3], to the transmitting end. . 
[0298] . Then, in the data transmission apparatus 
109 at the transmitting end, the retransmission requests 
are received by the retransmission instruction receiving 
unit 14, and the management information in the. 
sequence number correspondence management unit 
82 is retrieved on the basis of the requested high priority 
sequence numbers [H+2] and [H+3], thereby obtaining 
the sequence number [S+1] corresponding to the high 
priority sequence number [H+2] and the sequence 
number [S+2] corresponding to . the high priority 
sequence number [H+3] - 
[0299] Further, in the retransmission decision unit 
16c, it is decided whether the data of the packets corre- 
sponding to the sequence numbers [S+1] and [S+2] are 
stored in the retransmission buffer 17 or not. Based on 
the result of this decision, only the packets the data of 
which are stored in the retransmission buffer 1 7 are out- 
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put as retransmission packets from the retransmission 
buffer 17.1o the transmission queue, management, unit 
; .12. Here,.the high priority packets (S+1) and (S+2) are 
output as.retran$mission packets. ; - - : , f 
[0300] In the retransmission queue management: 
unit 12, the transmission order is set for these retrans- 
mission packets, and these packets are retransmitted to 
the receiving end through the transmission unit J 3. ^ 
Since the retransmission packets (S+1) and (S+2) are 
high priority packets, when transmitting these packets, 
the values- gf their transmitting end?, high priority 
• sequence numbers stored in the high priority sequence 
" number management unit 81 are incremented. 
[0301] To be specific, when transmitting the retrans- 
*mission packet (S+1), the value of the transmitting end 
high priority sequence number [H+3] stored in the high 
-priority sequence number management unit 81 is incre- 
mented to;"H+4", and the sequence number [S+1] of the 
retransmission packet (S+1) and the transmitting end 
tvhigh priority -sequence number [H+4] are entered, by 
one-to-one correspondence, in 3 the sequence number 
correspondence management unit 82. . 
[0302] : Further, when transmitting the retransmis- 
i sion packet (S+2), the value of the transmitting end high 
priority sequence number [H+4] stored in the high prior- 
ity sequence, number management unit 81 is incre- 
mented to "H+5?, and the sequence number [S+2] of the 
retransmission packet (S+2); and the transmitting end 
. high priority sequence number [H+5] are entered, by 
one-to-one correspondence, in the sequence number 
-correspondence managementunrt 82. v ; 
, [0303] w As described above,, according, to the ninth 
embodiment of the invention, data transmission from 
the transmitting end to the receiving end is continuously 
.performed* jn units of packets, each packet having addi- 
tional information relating to its sequence number, prior- 
: ity, and data reproduction time, and irrformation relating 
: to the high priority, sequence number managed at the 
transmitting end and, simultaneously, data of received 
packets are successively reproduced at the receiving 
end. The value of the transmitting end high .priority 
sequence, number possessed by the received packet 
(number of transmitted high priority packets) , is com- 
pared with the value of the receiving end high priority 
. sequence -number, managed at the receiving' end 
. (number of received high priority packets), and a 
retransmission request is made by indicating a transmit- 
ting end high priority sequence number which is absent. 
-Therefore; the transmission quality of the ratio section in 
real-time transmission can be improved by retransmis- 
sion of error packets the priorities of which are equal to 
or higher than a predetermined value and, moreover, 
the retransmission of error packets can be realized by 
simpler procedures. r 

[0304] In this ninth embodiment when the high pri- 
ority sequence numbers corresponding to plural high 
priority packets transmitted are continuously absent, the 
receiving end sends a retransmission request for each 
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high priority packet having the absent high priority packet detection unit 22a of the data receiving appara- 
sequence7iurhber*^to the trarismittihg- erid. However, * 'tus 209 of J ttie ninth embodiment The error packet 
retransmission^ teqtiests forptural high priority packets 1 ' : detection -unit 22b performs the same process as that of 
may be sertt collectively to the transmitting end/ by list-- trie unit 22a~and, i further, decides the transmission sta- - 
ing the values of the plural high priority sequence num- ; ^ s u " tus of the radid section, from the number of the detected 
bers or indicating the- range.of these values.'^-> *>r\ : i-'eitor packets. -. 

[0305] In this case, at the 4ransrrutfii^g" end; based ; r -103111 ir Fiirtherrthe : data receiving apparatus 210 
on the plural high priority sequence numbers requested -'■ -includes a retransmission instruction output unit 26d; 
from the receivingpend, th^ r ^u^nce'nurftber§^coff^ ^< -instead of the'retransmission instruction output unit 26c 
sponding to thV respective transmrttPng end high priority > * of thedata receiving apparatus 209: The retransmission 
packets are obtained by retrieval, and the high prfority -\ '^iristruction output unit 26d performs the same process 
packets having -the. sequence numbers so Obtained are i £v ' : *as that of the unit 26c and, further, outputs the transmit- 
retransmitted to the receiving endX * •> •* *• * T1 J? feci retransmission 1 request as a control signal.- : v: - 

\ £<./ -'e r w v-sr. [0312] Further, We data' receiving apparatus : 210 " 

[Embodiment 10]'- r ' ■ ' - lA v T ~. v c JT rs^mcludes a retransmission instruction consecutive out* 

**- r "■ * v,- . ■ l - "~. v . % tsxo?.. r^'-jp&t urtu 93v-^hich >eceivds the ; bdntrolt i signal'Xretrans- ^ 

[0306] In a data- transmission method according fb ~> ^.mission request) "output' from the retransmission - 
a tenth embodiment of the^rprese^^irrverttibnV M and consecutively outputs' ' 

number of times of retransmisfcrort requests to the trans- *>s»j -the retraifemi^Siorf request by a predeteYmined numbor 
mitting end and the interval of the retransmis&oh 

requests are changed according^ 40 the transmissioh ' " \ changes then number of output times i of retransmission ' r 
status of the radio section, whereby the probability of t * request and the output interval; according to information 
normal transmission of the retransmission requests X6 ' indicating the transmission status of the radio section,^ 
the transmitting end is increased To Improve the^trans- ' which is output frorn the error packet detection unit 22b. 
mission quality in the radio section. r '^2B ^[0313] c-Other constituents of the data" receiving v * 

[0307] Rgure 32 is a block diagram Illustrating a ■: v apparatus 210 of this tenth embodiment are identical to^ 
data transmission apparatus 110 in a daftatrdnsmisston those of the data' receiving' apparatus 209 of the ninth * ? 
system performing rear-time data transmission accord 4 - ^fnbodimerrtf : ' , " - 

ing to the data'; transmission method of this tenth * [0314] -Next the function and effect will be - 
embodiment. - ~. -•»?' - $o .described. ' *»' ' ~" : 

[0308] The data - transmission apparatus 110 - -[0315] Since the fundamental data transmission 
includes a retransmission decision unit 16d^ihsteadbf v process according to the data transmission method of 
the retransmission decision unit 16c of the^data trans- m- ^this tenth^'embodiment is identical tb that of the ninth 
mission apparatus 1t)9 of the Rinth^embodimerrtPThe r ^e&nbodimefrt, only a distinctive process of this tenth **■ 
retransmission /decision unit 16d performs the iSahw^ 35 ' "drnbodimerrt will be*described hereinafter. -■■ " . 
process as that of the decision unit 16c^jid, farther, oufr^' t " [0316] In this tenth embodiment the packet from 
puts the sequence number of" the' packet whiChMs-- irr the transmitting end is received by the receiving unit 21 
decided to be transmitted. Further; the data transmit .and output to the error packet detection unit 22b. In the 
sion apparatus 1 10 includes a sequence number corre^ - * -t error packetdetection unit 22b, the transmission status 
spondence management unit 82a, 'instead bf -the ^ -w of the radio section is detected according to^the output - 
sequence "number correspondence management unit ?. of the receiving, unit 21; and information indicating the 
82 of the data transmission apparatus 109r The- >transmission status of the radio section is supplied to 
sequence number correspondence management wit the retransmission instruction consecutive output unit 
82a performs the same process as that of the unit 82 ^ : 93. 

and, further, deletes the value = of the tranonitting end 46* [0317] On the other hand, when the high priority 
high priority sequence number corresponding to the r sequence number output from the retransmission 
value of the sequence number supplied from the sequence output unit 92 is input to the retransmission 
retransmission decision unit 16d. Other constitutes of - instruction output unit 26b, a retransmission request 
the data transmission- apparatus 110 of this tenth • ' indicating the high priority sequence number is output 
embodiment are identical to those of the data transmis- so from the retransmission instruction output unit 26b to 
sion apparatus 109 of the ninth embodiment. the transmitting end and; simultaneously, this retrans- 

[0309] ' Figure 33 is a block diagram illustrating a mission request is output as a control signal to the 
data receiving apparatus 210 in the data transmission retransmission instruction consecutive output unit 93. 
system performing real-time data transmission accord- ■ [0318] Then, the retransmission instruction consec- 
ing to the data transmission method of this tenth ss utive output unit 93 performs a consecutive retransmis- 
embodiment vision - process- for consecutively transmitting the 

[0310] : The data receiving apparatus 210 includes - retransmission request by several times. In this consec- 
an error packet detection unit 22b, instead of the error utive retransmission process, the number of transmis- 
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sion times of the retransmission request- and, the 
transmission interval are adjusted on the basis of a pre- 
determined value, according tojhe transmission status 
of the radio section- which is obtained from the output 
information of. the error packet detection unit 22b. ■ » v . 5 
[0319] : For example, when many transmission 
errors occur in the radio section, the numberof request 
transmission times is increased and. the output interval 
is increased; Thereby, the probability of normal -trans- 
mission of the retransmission request to the transmitting 10 
end increases On the. other ;hand, whenr.not ;many 
transmission • errors occur, in ther radio section, 4he 
number of . request transmission .times is decreased, 
and the output interval is narrowed. Thereby, the time 
required for retransmission is reduced. 1$ 
[0320] Further, at the transmitting end, • packet 
retransmission is carried out according to the retrans- 
mission -request,, and the sequence.: number, corre- 
spondence management unit 82a deletes the value of 
the transmitting end high priority sequence number cor- 20 
responding to the sequence number supplied from the 
retransmission decision unit 1 6d.> . : , . . ; 3 - 
[0321 ] L /Therefore, with respect to the same retrans- 
mission request which is received again, retrieval for the 
sequence number corresponding to this retransmission 25 
request by the retransmission decision unrt*16d ends in 
failure because the correspondence between the trans- 
mitting end high priority sequence number indicated by 
this retransmission request and the sequence number 
is deleted from the sequence number correspondence 30 
management unit 82a. • r 

[0322] As the result, in the retransmission decision 
unit 16d, rt is decided that no retransmission is per- : 
formed for the high priority packet for which the retrans-t> - 
mission request has been made by indicating the value r '?S5 
of the transmitting end high priority sequence number. v > £ 
Therefore, at the transmitting end, rt is avoided that the f ' 
same packet is repeatedly retransmitted when the same 
retransmission request is output several times from the 
receiving end. ■ 40 

[0323] As described above, according to the tenth 
embodiment of the present invention, a retransmission 
request indicating the high priority sequence number of 
a desired packet is consecutively transmitted several 
times, from the receiving end to the transmitting end, 45 
against transmission errors. Therefore, when at least 
one of the "several transmission requests from the 
receiving end is normally received at the transmitting 
end, the error packet the priority of which is equal to or 
higher than a predetermined value can be retransmit- so 
ted, whereby the transmission quality in the radio sec- 
tion in real-time transmission can be effectively 
improved. ■ - 1 r 

[0324] Hereinafter, a description will be given of the 
data structure of a packet Pa for transmitting data by a ss 
data transmitting method according to any of theafore- 
mentioned embodiments. 

[0325] Figures 34(a)-34(c) are diagrams illustrating 



>89 A2 58 

the data*stnj^ture ofthe pecket Pa. , fc r.U r ?t 
[0326] Thispackel Pa ©composed of a header Sec- 
tion Ph which contains relevant intonation indicating the 
attribute of the packet, and a data section Pd which 
stores data to be transmitted (figure 34(a)). 
[0327] r ; The header section Ph includes header into- 
nation la indicating the sequence number correspond- 
ing to each packet, header information lb indicating the 
reproduction time at the receiving end; of the data to be 
transmitted {time stamp) lb, header information indicat- 
ing the priority of each packet, extension header infor- 
mation Id, and other header information 11 to 110 (refer 
to figure 34(b)). : - ,> ; 

[0328] The specific convention of each header 
information is described in RFC 1889 as shown in f igure 
34(c). For example, the header information 13 indicates 
that the extension header information id is added to the 
header section Ph when its value X is 1. The header 
information 15 indicates that the data stored in the data 
section i3 coded data by the MPEG1 method when its 
value PT is 32, and indicates that the data stored in the 
data section is coded data by the MPEG2 method when 
PT is 33. Further, each of the header information 19. Ic, 
110, and 11 1 is header information to be added when the 
MPEG1 coded data is transmitted by RTP. The value P 
(P=1) of the header information Ic indicates that the 
data in the data section is I frame data, and the packet 
containing this I frame data is to be treated as a high pri- 
ority packet The value P (P=2) indicates that the data in 
the data section is P frame data, and the packet contain- 
ing this P frame data is to be treated as a low priority 
packet. The value P(P=3) indicates that the data in the 
data section is B frame data, and the packet containing 
this B frame data is to be treated as a low priority 
packet. -i: "r ' •• r.* ' t *■ •» rVv-' - 

[0329] Further, 1 the extension header information Id 
corresponds to the sequence number and the priority 
informatiorvof the previous packet in the third embodi- ; 
ment (refer to figure 6), the sequence number and the 
retransmission count of the previously transmitted high 
priority packet in the fourth embodiment (refer to figures 
13 and 14), the sequence number and the reproduction 
time of the previous packet in the second modification of 
the sixth embodiment (refer to figure 21), the difference 
value of the sequence number of the previous packet 
and the difference value of the reproduction time of the 
previous packet in the third modification of the sixth 
embodiment (refer to figure 22), and the transmitting 
end high-priority sequence number in the ninth embodi- 
ment (refer to figure 29). '■• - 

Claims ' 

1 . A data transmission method for performing continu- 
ous data transmission from the transmitting end to 
the receiving end in units of packets, each packet 
having additional information relating to its 
sequence number, priority, and data reproduction 
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time at the receiving end, while successively repro- tion relating to the sequence number and the 

ducing data of packets received pu ttie receiving- ~ . - ~ priority of a predetermined packet is also 

end, said method comprising tho steps of: - ... n; embedded in a subsequent packet to be trans- 

* ' , - , mitted'after the predetermined packet; and 

at the transmitting .end, * J *z * 5 \^ at the reaving end; in the case where a trans- 

: : ~: ' ! . --sr *• mission? error has occurred in the predeter- 

gMngprionty. information to each packet to ^:: ; r. mined packet and the additional intonation of 

be transmitted; and . , . * ^. the predetermined "packet has an error, a 

-r ' storing;, as retransmission data, only data c r t retransmission:- request for the predetermined 

. of packets Jhe priorities of which are equal -'io~i packet as art error packet -is made on the basis 

■ to or higher than a predetermined value^ in • . & : ^ .of tire additional information of the predeter- 
. a retransmission buffer; V- --i' mined packet which is embedded in the subse- 

. **. - . r . bv quent packet;' when "the subsequent packet 

at the receiving end, ,. i ; ' transmitted after:the predetermined packet is 

, ?z' 1 . . .jrT ^fff'£ k received. r. : - * , 

when , a transmission error & detected, * i v c c , - 

. . detecting the priority information rot an .;; -5. The data transmission method of Claim 4 wherein: 

error packet; and: - > \ ■ ..ic-^!^ ! % ■ j o; ^ .. ..... 

when the detected priority is equal ;to or > ' at the transmitting end.the process of embed- 
higher than th<3 predetermined v^lue; out-,;. 20 ?. ding the sequence numberof & predetermined 
r putting a retransmission request forvtho : .1 "■.■--> * high priority* packet in* a -subsequent packet 
error pad<^ to the transmitting end by indi- ' which. follows4he predetermined tiigh priority 
eating the sequence number of this.error > ; l packet is continuously performed until a high 
packet; > v-r.\ . priority packet ;next to> the predetermined high 

: 25 priority packet is transmitted; and * ~. . 
at the transmitting end, - „ . * s at the receiving; end, the sequence number of 
- - , 0 ; , another, packet which is embedded in the 
>, only when the data of the packrt .having - receivedpacket is extracted, and when a traris- 
~ the sequence number which is indicated, mission error has occurred in the packet of the 
by the retransmission request from the.' so extracted .sequence number, a retransmission 
receiving end is stored in the retransmis- - • z: request for this .error packet is made by indicat- 
ion buffer, retransmitting the data of this „■/ 1 , ing the sequence number of this packet 
packettothe receiving end; and v ? ;ip i -*< 
^ discarding .the data stored in the retrans-:v 6. A datac transmission apparatus for relaying data 
r v rnission buffer in rprd^er sta'iing froman/r 3S:- t which are successively transmitted from the trans- 
packet which cannot be in time for data mittingerajin jjnits of packets, each packet having * 
r - reproduction at the receiving end. ~ additional, information relating to its sequence 
, . v:-., - - i„ . ' .' z v-i?:?': ^ -z number,: priority; and .data reproduction time at the 
The data transmission method; of, Claim 1 whereihj^-r v receiving end, said apparatus comprising: 
when j the retransmission buffer Is filled up to fc -v. * y^r ? 
capacity, an updation process is performed, in a receiving unit for receiving the packets trans- 
whichjhe retransmission data are retained while , : mitted from the transmitting end; ' . 
the data stored in. the retransmission buffer are dis- a priority decision; unit for deciding the priority 
carded in order,* starting from a packet of the. earii- . , \ \r . of each of the received packets; 
est . reproduction time,- on the basis- of . the - 45 : a retransmission packet storage unit for storing 
reproduction time; of each packet stored in the ': i . packets the priorities of which are^ equal to or 
retransmission buffer. - -■ 1 . *- higher than-a predetermined value, as retrans- 
• i.: * mission packets, on the basis of the priority of 
Thedata transmission method of Claim 1 wherein, ... each packet decided by the priority decision 
when the data transmitted from the transmitting end so ; unit; 

to the receiving end is video data based on MPEG, , \ - a retransmission instruction receiving unit for 

a packet which contains data corresponding to receiving a. retransmission request from a ter- 

frames coded by utilizing intra-frame correlation is - , minal at the receiving end; 

regarded as a packet having a high priority a retransmission decision unit for deciding 

- ; ■:- ss . whether retransmission of the packet for which 

The data transmission method of Claim 1 wherein: r the retransmission request has been made 

- i«- shoutd.be performed or notion the basis of the 

at the transmitting end, the additional informa- retransmission request and the storage status 
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of the retransmission packets in the retransmis- : . 
sion packet storage unit; - -~ *./ . *\ 
a transmission queue management unit for set- 
ting the transmission order,, of the received 
packets and the packets which have been s 
decided as packets to be retransmitted; on the 
basis of the additional information; and^r 
a transmission -unit for.transmjtting the data of 
these packets in .the transmission order set by 
the-management unit r. ; s i w 

7. A data receiving apparatus for receiving data which 
are transmitted from the transmitting end in units of 
packets, each packet having additional information 
relating to jte sequence number, priority, * and data is 
reproduction time at the receiving end, and succes- 
sively reproducing the data -for each packet, said 
apparatus comprising: yr 

a receiving unit for receiving the packets trans- 20 
mitted from the transmitting end; •■-> 
an error packet, detection unit for detecting 
error packets injwhich -errors have occurred 
during transmission, and . outputting norma! 
packets which have been transmitted, without 25 
transmission errors, on the basis of the data of 
the received packets; v . — 

a packet priority decision unit for receiving the 
output from the error packet detection unit, and 
deciding error packets the priorities of which: : so 
are equal to or higher than a predetermined 
value; and . 
a retransmission instruction outputxinit for out- 
putting a retransmission request for each of the , t 
error packets the priorities of which are decided < 35 
as being equal to or higher than the predeter- ; j-- 
mined value, to the transmitting end, by indicat- . * . 
ing the sequence number of this error packet 

8. A data transmission method in which data transmis- 40 
sion from the transmitting end to the receiving end 
is continuously performed in units of packets, each 
packet having additional information relating to its 
sequence number, priority, and data reproduction 
time at the receiving end, while successively repro- 45 
ducing data of packets which have arrived at the 
receiving end and, at this time, only packets which 
can be in time for data reproduction at the receiving 
end are retransmitted, said method comprising the 
steps of: so 

at the transmitting end, . . 

giving a data reproduction time at the 
receiving end to each packet to be trans- ss 
' mitted; and 

storing, as retransmission data, only data 
of packets the priorities of which are equal 



nf to or higher than a predotermineci value.M'n 
; « /©transmission buffer; ■= ; ^r-r;. *- w 

" at the receiving end, >r~: * .:. 

. when arrtransmission error is detected, 
: detecting the reproduction time for an error 
v\ packet and the arrival time of the error 
packet and deciding an arrival time limit in 
accordance with the reproduction time; 
■ _and : -:: 

. when the error packet has arrived before 
the arrival time limit, outputting a retrans- 
/ : -mission request for the error packet to the 
transmitting end -rby indicating the 
sequence number of this error packet; * 

at the transmitting end, ■:. 

when the data of the packet having the 
sequence number indicated by the retrans- 
mission request from the receiving end is 
stored in the retransmission buffer, retrans- 
mitting data of the packet the transmission 
time of which does not pass the reproduc- 
tion time, to the receiving end; while dis- 
carding data of ti-.e packet the transmission 
time of which has passed the reproduction 
time; and 

discarding the data stored in the retrans- 
mission buffer in order starting from a 
j ~- packet which cannot be in time for data 
reproduction at the receiving end. 

9. The data transmission method of Claim 8 wherein, 
when the retransmission buffer is filied up to its 
capacity, -an updation process is performed, in 
which the retransmission data are retained while 
the data stored in the retransmission buffer are dis- 
carded in order, starting from a packet of the earli- 
est reproduction time, on the' basis of the 
reproduction time of each packet stored in the 
retransmission butter. : 

10. The data transmission method of Claim 8 wherein 
the arrival time limit is decided based on at least 
one of the allowable packet delay time decided at 
the receiving end, arid the packet transmission 
delay time between the transmitting end and the 
receiving end. 

11. The data transmission method of Claim 8 wherein: 

at the transmitting end, additional information 
relating to the sequence number and the repro- 
duction time corresponding to a target packet 
to be transmitted is embedded in a subsequent 
packet to be transmitted after the target packet; 
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and 

at tiie^redfciving end, when a transmission error 
of the target packet has occurred ancfthe addi- 
tional information of the target packet has an 
error, a retransmission request for the target s 
packet as an error packet is made on the basts 
of the additional information .:of the target 
packet .which is -embedded in the subsequent 
packet whensthe subsequent packet transmit- 
ted .after the target-packet is received, c- & , 10 

12. A data transmission apparatus for relaying data 
which are successively transmitteddrom the 'trans- 
mitting end ip uruts otpackets, each'packethaving 
additional : information .relating to its resequence is 
number, priority; data^ reproduction time : at the 
receiving end, said apparatus comprising; y 

a receiving unit for receiving the packets trans- 
mitted from the transmitting end; 20 
a priority decision unit for deciding the priority 
of, each of the received packets; . r^ ti ty; t 
a reproduction time decision unit for deciding 
packets which cannot be in time for ^produc- 
tion at the receiving .end, amongst the packets 2s 
to be transmitted to the receiving. end; 
a retransmission packet storage unitfor storing 
packets the priorities trfrwhich-are equaLJo or 
higher than a predetermined value, as retrans- 
mission packets, on the basis of the priority of 30 
each packet decided by the -priority decision 
unit; - > - t 

& retransmission instruction receiving unit for 
receiving a retransmission request jfrom .a ter- 
minal at the receiving end; 35 
a, retFansmissicjn ' decision- unit,*for*ideeicHng 3: ." 
whether retransmission^ the -packet 4br whlcbisri* 
the retransmissiorv request - has been-m$de^r< 
should be performed or not on the-basis ofthe:^^ 
retransmission-request and; the storage status *o 
of the retransmission packets In the retransmis- ^ 
sion packet storage unit; .r« o ; ho*-;; * •> 
a transmission queue-management unit for. set- 
ting the transmission order of, the- received^, 
packets and the packets which have been as 
decided as packets to be retransmitted, on the hi ~ 
basis of the addrtional information; and r 3. 
a transmission unit for transmitting; in.the trans? 
mission order setty the management unit, the 
data of packets other than the packets which so 
are decided as packets that cannot be in time 
for reproduction at the receiving end, by the 
reproduction time decision unit. 



13. A data receiving apparatus for receiving data which 
are transmitted from the transmitting end in units of 
packets, each packet having additional information 
relating to its sequence number, priority, and data 
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reproduction time at the receiving end, and succes- 
sive! ^reproducing f^e data for each packet said 
apparatus comprising: \ 

a receiving unrt for receiving the packets trans- 
" mrtted from the transmitting 1 end; 

an error^paeket detection - unit for detecting 
error packets in which errors have occurred 
during." transmission, ^and outputting norma! 
packets^which have been transmitted without 
transmission errors, on the basis of the data of 
the received packets; 

a reproduction time decision unit for detecting - 
the reproduction time r given to each error 
packet detected by 1 the error packet detection 

«-. urrft and the : airrival time-of the error packet at 
the receiving end. n ancT setting the arrival time 
limit based: on. the- reproduction timS, and ' 
deciding whether or not the error packet has- \ 
arrived at the receiving end before the arrival 
time limit; and e * v ■ ^ » v 
a retransmission Instruction output Unit for out- 
putting a retransmission request- only for the 
error packet which has arrived at the receiving 
end before the arrival time limit, to the transmit- % 

w ting end. by indicating the sequence number of £ 
the^error packet, on the basis of the result of" 
the decision in the reproduction time decision >• 
unit^/s if--* * * ... 

14. A data transmission method for performing continu-^ 
ous data transmission from the transmitting end to - 
the receiving end in units of packets, each packet ^ 
having. : additional* /information relating to its i 
sequence number, priority, and* data reproduction * 

e time at the recerving^end, white successively repro- 
ducing data of packets arrived at the receiving end,' 
said method comprising the steps of: > ' 1 - 

at the transmitting end, 

- giving a data reproduction time and priority 
: information to each packet to be transmit-- 
: .ted; and : 

; storing, as retransmission data, only data - 
: of packets the priorities of which are equal 

. to or higher than a predetermined value, in * 
a retransmission buffer; 1 

at the receiving end, * 

when a transmission error is detected, 
detecting the priority information of an 
error packet the reproduction time of the 
error packet, and the arrival time of the 
- : - . error packet; . - 

setting the arrival time limit of the error 
packet on the basis of the reproduction 
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time; and ^ : " ' 

when the detected priority is equal, to or 
higher than the prbdetermined . v^iie and 
the error packet has arrived before the 
, arrival I time limit, outputtiqg a retransmis- s 
, sion request for this error packei'fo the 
. transmitting end *^by ~ J indicating - . the 
' sequence number of this . error packet; 

at the transmitting end. * 

y ; yrtier\ data of.tftf packet ^hawng the 
' ^.sequence number ihdicated by fte/ettans- 
mission request from fre recemng end is 
^ . stored in the retransmission buffer, fefeans- is 
~ ; ; : r^ng,only data of tbe; packet thej'trans- 
l . mission time of which does not pass the 
* " "'. reproduction tim$. "to .the receiving 'end, 
} while discarding d t at| of c the ^|»cket' the 
transmission time of whicrt has passed the 20 
reproduction time; and 
discarding the data stored in. the .retrans- 
mission buffer in order" starting' from a 
, packet which cannqt be in time for repro- 
duction at the receiving end. \ 2s 

15, ThedataCtratfismission method of Claim 14 wherein: 

at the transmitting end, additional information 
relating to the sequence : nunrtoer, the priority, 30 
and the reproduction time of a predetermined 
packet is embedded in a subsequent packet to 
be transmitted after, the predetermined packet; . 
and ■ • ■ - • 

at the/ecehfing errcl. when ^ transmission enor 35 
of the predetermined pacfet has pa^edindV 
tKe additional information of the pre&eteirnihec( 
packet has an error, a retransmission request 
for the predetermined packet as an error 
packet is made on the basis of the additional 40 
information of the predetermined packet which 
is embedded in the subsequent packet, when 
the subsequent packet transmitted after the 
predetermined packet is received. . . 

1 6. The data transmission 'method of Claim 15 wherein: 

at the transmitting end, the process of embed-, 
ding the sequence number of a predetermined 
high priority packet in : a subsequent packet so 
which .follows the predetermined high priority 
packet is continuously performed until a high 
priority packet next to ; the predetermined high, 
priority packet is transmitted; and v . 
. . , at the receiving end, the sequence, number of ss 
another packet which is embedded in the 
received packet is extracted, and when a trans- 
mission error has occurred in the packet of the 



^ctracie^i sequence number a retr^s^^Jptn 
re<5jLfest fer ^ this packet is made.by ideating the 
sequence number of this packet 

17. Thedjrtatran^ ISwherein, 
at the transmitting end, when additional information 
relating to the sequence number and the reproduc- 
tion time corresponding to each packet is embed- 
ded in a subsequent packet to. be transmitted after 
the packet, a difference between additional infor- 
mation relating to the sequence, number and the 
reproduction time corresponding to the subsequent 
packet and the additional inlprmation relating to the 
sequence number and the reproduction time corre- 
sponding p, the previous pai^ Js errtsedded as 
the additional information. , 

18. A data' .transmission -rneth^ ;ibr ; performing data 
^nsmi^ion i^ew a server and a 
terminal through,a relay server in units of packets, 
and successively reproducing data of packets 
received at the terminal, said method comprising 
the steps of:r . ~ 

when a transmission error has occurred 
between the relay server and the terminal, per- 
forming retransmission of an error packet by 
the relay server in response to a retransmis- 
sion request from the terminal; and : 
when a transmission error has occurred 
between the distribution server and the relay 
server,, performing retransmission of an, error, 
packet by the distribution server in response to 
a ^r^rasmissipn. rj^uest w^ch has been - 
transmitted from the. tenronal, through the relay . 
server. 

1 9. The data transmission method of Claim 1 8 wherein, 
when a transmission error has occurred between 
the distribution server and the relay server, a 
retransmission r request is transmitted from the relay 
server to the distribution server, and retransmission 
of an erro; packet to the relay server is performed 
by the distribution server. 

20. A data transmission apparatus for relaying data 
which are successively transmitted from a distribu- 
tion server, in units of packets each having addi- 
tional, information relating to its sequence number, 
priority, data reproduction time at the receiving end, 
said apparatus comprising: .. 

a receiving unit for receiving the packets trans- 

mitted from the transmitting end; 

a priority decision unit for deciding the priority 

of each of the received packets; . 

a retransmission packet storage unit for storing 

packets the priorities of which are equal to or 
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higher than a predetermined value, as retrans- 
mistion^ckets. on the basis "of the prjbnty of 
eadr packiet decided by the priority decision 
unit; * * " * "* 

a retransmission instruction receiving unit for s 
receiving a retransmission ^ ' 
minal at the receiving end; "* * ' -^V 
a retransmission decision unit for ''deciding 
whether retransmission of thi packet for^ich *\ 
the retransmission request has been miide Ik : *jo 
to be performed or not on the basis 6f v the : 
retransmission request and the storage" status 1 ~ 
of the retransmission packets in the retransmis- 
sion packet storage unit; • ' : ' 
a retransmission instructron output unit for but- ' 15 
putting the retransmission request for the error 
packet requested by the terminal: to ttie distri- 
bution server, on the basis of the result of the 
decision in the retransmission decision unit; 1 " : 
a transmission cjueiie > management unit for'set-' 20 
ting the transmission order of the' received 
packets and the packets which havtfbe^n " u 
decided as packets to be retransmitted /on the" " 
basis of the additional information; and * 5 " 
a transmission unit for transmitting the data of 2s 
these packets in the transmission order set by. 
the management unit * : ir " ' * - ■ ' 

A data transmission method for performing *c6rrtinu- 
ous data transmission from the transmitting endlo 30 
the receiving end in units of packets, r iach packet 
having additional information relating 4o its 
sequence number, priority, and data ' reproduction 
time at the receiving end, while successively repro- 
ducingdata of packets' received at the receiving" ss 
end, said method comprising the'steps" of r ^ ^ x ' 

at the transmitting end, 

• * , * • -\ ; • "*. - r c -, ' ^ " 

when a packet the priority of Which is equal ' 46 
to or higher than a predetermined value is 
transmitted as a high priority packet, stor- 
ing data of this high priority packet; as 
retransmission data, in' a retransmission 
buffer; ' • r - - " 4S 

managing the value of the transmitting end 
high priority sequence number which cor- 
responds to the number of transmitted high ' 
- priority packets, - and the value of the 
sequence number of the high priority so 

~ ' packet so that these values are correlated : 
with each other; and ' * 

transmitting a subsequent packet which 
" follows ' the high priority packet after 
embedding the value of the transmitting ss 

■- ■ end high priority sequence number in this 
subsequent packet; * 



at the receiving end, 

iaxtriacting the value of the transmitting end 
high priority sequence number, which is 
embedded in jhe received packet; 
* . managing the value of^ the receiving" end 
. highjpnprity sequence number which cor- 
x responds to the number of received high 
priority packets; 

when the value of the extracted transmit- 
ting end high priority sequence number is 
not equal to the value of the receiving end 
high priority segudrice number, outputting 
a r6transmisslqh request' to the transmrt- 

' jfiiQ* end, by indicating the value of the 
^i^nsnSittingfend high priority sequence 

/ 'number^which ife obtained on the basis of 
the value bf the receiving end. high priority 
j r sequence number; and" " * 

' . updating the value' of the rebeiving end 

" fi high priority 1 sequence rwmber? ' ' [[' 

at thiB ftaiismitting end,* 1 ' "]"\ 

only when data' of the patkesi having the 
sequence number corresponding to ther 
value of the transmitting end high priority 
' sequence number which is indicated by 
. the retransmission request from the receiv- 
ing end is_ stored in the retransmission 
j buffer, I rdbBn'snrtitting the data of this k 
L ^ packet tbthb receiving end. ^ 1 

22. The data transmission method of Claim 21 wherein: iVr 

1 - at the reiving end, ;when the value of the 
trknsmrtting end high priority sequence number 
embedded iri ttte received packet is not equal 
l> to 'the value of the receiving end high priority 

sequence number, a retransmission request is 
output to the transmitting end, by listing the val- 
ues ranging from the value obtained by adding 
1 to the' receiving end high priority sequence 
number, 1o the value of the transmitting end 
high priority sequence number, as the values of 
the transmitting end high priority sequence 
numbers, or by designating the range as the 
range of the values of the transmitting end high 
priority sequence numbers; and 
at the transmitting end, the sequence numbers 
corresponding to the values of the plural trans- 
mitting end high priority sequence numbers 
which aria indicated by the retransmission 
request from the receiving end are retrieved, 
and only when data of the packets having the 
sequence numbers obtained by the retrieval 
are stored in the retransmission buffer, the data 
of the packets are retransmitted to the receiv- 
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ingend. 

23. The data transmission method of Claim 21 wherein: 

at the receiving end, the retransmission s 
request is performed continuously be several 
times, indicating the value of a transmitting end 
high priority sequence number; and 
at the transmitting end, the sequence number 
corresponding to the value of the transmitting 10 
end high priority sequence number which is 
indicated by the retransmission request from 
the receiving end is retrieved, and data of the 
packet having the sequence number obtained 
by the retrieval is retransmitted to the receiving is 
end and, simultaneously, the correspondence 
< between the value of the sequence number 
obtained by the retrieval and the value of the 
transmitting end high priority sequence number 
indicated by the receiving end is deleted. 20 

24. A data transmission apparatus for relaying data 
which are successively transmitted from the trans- 
mitting end in units of packets, each packet having 
additional information relating to its sequence 25 
number, priority, data reproduction time at the 
receiving end, said apparatus comprising: 

a receiving unit for receiving the packets trans- 
mitted from the transmitting end; 30 
a transmission queue management unit for set- 
ting the transmission order of the received 
packets and packets which are decided as 
packets to be retransmitted; 
a transmission unit for transmitting data of 3s 
these packets in the transmission order set by 
the transmission queue management unit; 
a priority decision unit for deciding the priority 
of each of the received packets; 
a retransmission packet storage unit for storing 40 
packets the priorities of which are equal to or 
higher than a predetermined value, as retrans- 
mission packets, on the basis of the priority of 
each packet decided by the priority decision 
unit; 45 
a sequence number management unit for man- 
aging the value of the transmitting end high pri- 
ority sequence number which corresponds to ~ 
the number of transmitted high priority packets, 
and the value of the sequence number of the so 
high priority packet so that these values are 
correlated with each other; 
a high priority sequence number insertion unit 
for embedding the value of the transmitting end 
high priority sequence number in a subsequent 55 
packet which follows the high priority packet; 
a retransmission instruction receiving unit for 
receiving a retransmission request indicating 



the 'high-priority sequence number, from a ter- 
minal at the transmitting iehd; and 7' 
a" retransmission decision unit 'for deciding 

- Whetffer retransmission of the packet for which 
the retransmission request has been made is 
to be performed or not, on the basis of the 
retransmission request and the storage status 
of the retrahsmission packets in the retransmis- 

- sion packet storage unit. '* ; ^-->.». 

25. A data receiving apparatus for receiving data which 
are transmitted from the transmitting end in units of 
packets, each packet having '-additional' intonation 
relating to its ' sequence number, priority, and data 
reproduction time at the receiving end, and succes- 
sively reproducing the data for each packet said 
apparatus corriprising: * 

- a receiving unHf for receiving the packets trans- 
mitted from the transmitting end; 

an error packet detection unit for detecting an 
error packet in which an error has occurred 
during transmission, and outputting a normal 
packet which has been transmitted without 
transmission errors, and the value of the trans- 
mitting end high : priority sequence number 
which corresponds to the number of transmit-- 
ted high priority packets arid is embedded in 
the normal packet; 

a high priority sequence number management 
unit for managing the value of the receiving end 
high priority sequence number which corre- 
sponds to the number of normal high priority 
packets which have been received without 
transmission errors, on the basis of the output 
from the error packet detection unit; 
a retransmission sequence number decision 
unit hr comparing the value of the transmitting 
r: end high priority sequence number from the 
error packet detection unit with the value of the 
receiving end high priority sequence number, 
and when these values are not equal, deciding 
the value of the transmitting end high priority 
sequence number for which a retransmission 
request is to be made, on the basis of the value 
of the receiving end high priority sequence 
number; and 

a retransmission instruction output unit for out- 
putting a retransmission request to the trans- 
mitting end, by indicating the value of the 
decided transmitting end high priority 
sequence number. 

26. A data structure of a packet for performing data 
transmission from the transmitting end and the 
receiving end, wherein: 

said packet comprises a header section con- 
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taining relevant information indicating the 
attribute the packet and a data section con? 
taining data to be transmitted; and ' .;. 
said header section comprises at least firstand 
seconds header information,.- amongst first s 
header- information-, indicating the , sequence 
number corresponding, to the pocket second 
header intonation indicating the DriQrity of the 
packet, andlh:rd header information indicating 
the reproduction time at the receiving end,, of io 
the data to be transmitted. 

- > : <w r : ' t -V- - * 

27. The packet data structure of Clainv26 wherein the . v - 
header section of the packet includes attribute infpr- • , 
mation of a packet which has already been trans- is 
mitted before the packet. * ^ . - . ■ . - d . r - ; 

28. The packet data structure of Claim 27 wherein, tfie,;;.' 
header section of the packet includes the first and 
second information or the first and ttyrd information, 20 
as attribute information of a packet which has 
already been transmitted before the packet : . f; - *\- 

29. The packet data, structure of Claims wherein the 
header section of the packet includes the value of 25 
the high- priority sequence number corresponding 

to the number of high priority packets which have 
been transmitted before the packet and haying the 
priorities equaJ to or higher than a predetermined 
value. . . v . - so 
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